{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "# 猎聘不同分类（公司、行业、城市）的行业数据分析\n",
    "* 数据加值宣言：本项目产出是对猎聘网挖掘的关于产品经理，用户体验的工作数据从公司、行业、城市三个角度出发，以解决对目前社会上对于这两种职业的需求情况以及行业现状的问题"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 数据最小可用产品\n",
    "* MVP的数据加值：该数据产品的数据类型分为三部分（公司、行业、城市）并分别以表格的形式呈现。\n",
    "公司部分导出了不同类型公司中用户体验的岗位内容；\n",
    "行业部分导出了不同行业里对快消品相关的岗位内容；\n",
    "城市部分导出了首都北京对产品经理岗位的详细内容。\n",
    "* 该内容可以帮助更好的看清或分析当前市场对这两个岗位的需求及形式"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 挖掘Query参数\n",
    "* 该数据产品核心价值的最小可用产品还可能可以进行其他的内容对比，例如薪资等"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "# 基本模块\n",
    "import pandas as pd\n",
    "from requests_html import HTMLSession"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>edu</th>\n",
       "      <th>经验</th>\n",
       "      <th>薪水</th>\n",
       "      <th>时间</th>\n",
       "      <th>职称</th>\n",
       "      <th>公司地点</th>\n",
       "      <th>公司名称</th>\n",
       "      <th>链结</th>\n",
       "      <th>公司URL</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>6-8k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>测试工程师</td>\n",
       "      <td>西安-未央区</td>\n",
       "      <td>星展测控科技股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927789815.shtml</td>\n",
       "      <td>https://www.liepin.com/company/10158561/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>学历不限</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>4-6k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>装配技工</td>\n",
       "      <td>西安-未央区</td>\n",
       "      <td>星展测控科技股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927789491.shtml</td>\n",
       "      <td>https://www.liepin.com/company/10158561/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>客户经理（汽车融资租赁）</td>\n",
       "      <td>南昌</td>\n",
       "      <td>创富融资租赁(上海)有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927788671.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7854759/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>16-25k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>golang开发工程师</td>\n",
       "      <td>成都-高新区</td>\n",
       "      <td>成都零点能量信息技术有限责任公司</td>\n",
       "      <td>https://www.liepin.com/job/1927787679.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9326766/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>15-20k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>成本工程师（土建）</td>\n",
       "      <td>承德</td>\n",
       "      <td>承德天缘盛世房地产开发有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927785791.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9143037/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>8-16k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>渠道经理</td>\n",
       "      <td>苏州</td>\n",
       "      <td>苏州浩辰软件股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927784455.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7965554/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>区域销售经理</td>\n",
       "      <td>上海</td>\n",
       "      <td>上海迪罗电气有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927784195.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7927458/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>国际保险理赔总监</td>\n",
       "      <td>大连</td>\n",
       "      <td>维特奥健康</td>\n",
       "      <td>https://www.liepin.com/job/1927783939.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8375949/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>5-7k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>出纳</td>\n",
       "      <td>深圳-龙华区</td>\n",
       "      <td>北京斯雷康科技股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927783881.shtml</td>\n",
       "      <td>https://www.liepin.com/company/1408548/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>18-25k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>java开发工程师</td>\n",
       "      <td>成都-高新区</td>\n",
       "      <td>成都零点能量信息技术有限责任公司</td>\n",
       "      <td>https://www.liepin.com/job/1927783543.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9326766/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>工业设计总监</td>\n",
       "      <td>佛山-顺德区</td>\n",
       "      <td>东方麦田</td>\n",
       "      <td>https://www.liepin.com/job/1927782651.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8353351/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>6-10k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>初中语文教师</td>\n",
       "      <td>常州</td>\n",
       "      <td>常州市昂立教育培训中心</td>\n",
       "      <td>https://www.liepin.com/job/1927782409.shtml</td>\n",
       "      <td>https://www.liepin.com/company/10090569/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>5-7k·14薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>实验室QA</td>\n",
       "      <td>杭州-江干区</td>\n",
       "      <td>杭康药业</td>\n",
       "      <td>https://www.liepin.com/job/1927782315.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8247321/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>8-15k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>PMC主管/经理（电商）</td>\n",
       "      <td>广州-天河区</td>\n",
       "      <td>广州麦匠信息科技有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927781753.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9356817/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>8-10k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>灯具结构工程师</td>\n",
       "      <td>东莞-南城区</td>\n",
       "      <td>东莞市神话照明科技有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927781619.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9639194/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>学历不限</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>10-30k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>直播媒介</td>\n",
       "      <td>北京</td>\n",
       "      <td>钱方好近</td>\n",
       "      <td>https://www.liepin.com/job/1927781015.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7863496/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>结构设计师/结构设计总监</td>\n",
       "      <td>重庆-璧山区</td>\n",
       "      <td>重庆山水主题小镇乐园综合开发有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927780571.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9946115/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>6-9k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>手机软件测试工程师</td>\n",
       "      <td>西安-鱼化寨</td>\n",
       "      <td>闻泰通讯股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927780385.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7857616/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>4-6k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>行政前台</td>\n",
       "      <td>成都-武侯区</td>\n",
       "      <td>贵州星臣教育管理有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927780343.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9495905/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>5-9k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>冲压模具工程师</td>\n",
       "      <td>绍兴</td>\n",
       "      <td>浙江格洛博机械科技股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927779863.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9523207/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>8-15k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>采购工程师</td>\n",
       "      <td></td>\n",
       "      <td>中电华瑞</td>\n",
       "      <td>https://www.liepin.com/job/1927779829.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7887439/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>硕士及以上</td>\n",
       "      <td>10年以上</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>高端幼儿园教学园长（徐汇古北）</td>\n",
       "      <td>上海-虹桥</td>\n",
       "      <td>上海艾文格林教育科技有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927779743.shtml</td>\n",
       "      <td>https://www.liepin.com/company/10049561/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>6-8k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>海信大地 销售业务经理</td>\n",
       "      <td>青岛</td>\n",
       "      <td>青岛海信广场</td>\n",
       "      <td>https://www.liepin.com/job/1927779595.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8126962/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>国际销售（J10390)</td>\n",
       "      <td>上海-浦东新区</td>\n",
       "      <td>西域供应链</td>\n",
       "      <td>https://www.liepin.com/job/1927779263.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8396469/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>15-20k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>空间高级设计师</td>\n",
       "      <td>深圳</td>\n",
       "      <td>黄志达</td>\n",
       "      <td>https://www.liepin.com/job/1927778981.shtml</td>\n",
       "      <td>https://www.liepin.com/company/1668168/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>3-5k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>行政专员岗</td>\n",
       "      <td>天津-南开区</td>\n",
       "      <td>绝味食品</td>\n",
       "      <td>https://www.liepin.com/job/1927778529.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9216518/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>15-30k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>独立站站长</td>\n",
       "      <td>杭州-西溪</td>\n",
       "      <td>新兔科技</td>\n",
       "      <td>https://www.liepin.com/job/1927778439.shtml</td>\n",
       "      <td>https://www.liepin.com/company/10100579/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>10-15k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>园区资产总监</td>\n",
       "      <td>郑州</td>\n",
       "      <td>河南保税物流</td>\n",
       "      <td>https://www.liepin.com/job/1927778357.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8860911/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>30-40k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>财务总监</td>\n",
       "      <td>杭州-宁围</td>\n",
       "      <td>多弗国际地产股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927778333.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9725118/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>6-10k·14薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>招商运营岗</td>\n",
       "      <td>厦门</td>\n",
       "      <td>七匹狼控股集团股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927778325.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7902722/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>10-20k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>运营岗</td>\n",
       "      <td>上海</td>\n",
       "      <td>贵安恒信融资租赁(上海)有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927778071.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9487261/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>建材事业部副总经理</td>\n",
       "      <td>海东</td>\n",
       "      <td>金圆环保</td>\n",
       "      <td>https://www.liepin.com/job/1927777833.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9523659/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>15-25k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>前期经理/主管</td>\n",
       "      <td>北京</td>\n",
       "      <td>北京永聚铭创科技有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927776795.shtml</td>\n",
       "      <td>https://www.liepin.com/company/2218571/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>大专及以上</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>10-25k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>嵌入式高级软件工程师</td>\n",
       "      <td>上海</td>\n",
       "      <td>上海释创测控技术有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927776653.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8868355/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>矿山地质景观规划设计师</td>\n",
       "      <td>上海-程家桥</td>\n",
       "      <td>鹏欣资源</td>\n",
       "      <td>https://www.liepin.com/job/1927776223.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8282661/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>8-12k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>IR投资人关系</td>\n",
       "      <td></td>\n",
       "      <td>上海多鲸企业管理咨询有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927776133.shtml</td>\n",
       "      <td>https://www.liepin.com/company/10130433/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>一年以下</td>\n",
       "      <td>4-9k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>2020届毕业生</td>\n",
       "      <td>青岛-黄岛区</td>\n",
       "      <td>雷沃工程机械集团有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927775733.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9209355/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>技术总监（U3D方向）</td>\n",
       "      <td>深圳</td>\n",
       "      <td>深圳国泰安教育技术有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927775275.shtml</td>\n",
       "      <td>https://www.liepin.com/company/870249/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>4-8k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>电商平台销售管理员</td>\n",
       "      <td></td>\n",
       "      <td>虎牌石油(中国)有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927775097.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8812459/</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>8-15k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>数据分析</td>\n",
       "      <td>上海-龙华</td>\n",
       "      <td>北京斯雷康科技股份有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927774231.shtml</td>\n",
       "      <td>https://www.liepin.com/company/1408548/</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      edu     经验          薪水           时间               职称     公司地点  \\\n",
       "0   大专及以上   3-5年    6-8k·12薪  2020年04月26日            测试工程师   西安-未央区   \n",
       "1    学历不限   1-3年    4-6k·12薪  2020年04月26日             装配技工   西安-未央区   \n",
       "2   大专及以上   1-3年          面议  2020年04月26日     客户经理（汽车融资租赁）       南昌   \n",
       "3   本科及以上   3-5年  16-25k·12薪  2020年04月26日      golang开发工程师   成都-高新区   \n",
       "4   大专及以上  5-10年  15-20k·12薪  2020年04月26日        成本工程师（土建）       承德   \n",
       "5   大专及以上   3-5年   8-16k·12薪  2020年04月26日             渠道经理       苏州   \n",
       "6   大专及以上  5-10年          面议  2020年04月26日           区域销售经理       上海   \n",
       "7   本科及以上   经验不限          面议  2020年04月26日         国际保险理赔总监       大连   \n",
       "8   大专及以上   1-3年    5-7k·12薪  2020年04月26日               出纳   深圳-龙华区   \n",
       "9   本科及以上   3-5年  18-25k·12薪  2020年04月26日        java开发工程师   成都-高新区   \n",
       "10  大专及以上  5-10年          面议  2020年04月26日           工业设计总监   佛山-顺德区   \n",
       "11  本科及以上   3-5年   6-10k·12薪  2020年04月26日           初中语文教师       常州   \n",
       "12  大专及以上   1-3年    5-7k·14薪  2020年04月26日            实验室QA   杭州-江干区   \n",
       "13  大专及以上   3-5年   8-15k·12薪  2020年04月26日     PMC主管/经理（电商）   广州-天河区   \n",
       "14  大专及以上   3-5年   8-10k·13薪  2020年04月26日          灯具结构工程师   东莞-南城区   \n",
       "15   学历不限   经验不限  10-30k·12薪  2020年04月26日             直播媒介       北京   \n",
       "16   统招本科  5-10年          面议  2020年04月26日     结构设计师/结构设计总监   重庆-璧山区   \n",
       "17   统招本科   3-5年    6-9k·13薪  2020年04月26日        手机软件测试工程师   西安-鱼化寨   \n",
       "18  本科及以上   1-3年    4-6k·12薪  2020年04月26日             行政前台   成都-武侯区   \n",
       "19  大专及以上   3-5年    5-9k·12薪  2020年04月26日          冲压模具工程师       绍兴   \n",
       "20  大专及以上   1-3年   8-15k·12薪  2020年04月26日            采购工程师            \n",
       "21  硕士及以上  10年以上          面议  2020年04月26日  高端幼儿园教学园长（徐汇古北）    上海-虹桥   \n",
       "22   统招本科   经验不限    6-8k·13薪  2020年04月26日      海信大地 销售业务经理       青岛   \n",
       "23  本科及以上   1-3年          面议  2020年04月26日     国际销售（J10390)  上海-浦东新区   \n",
       "24   统招本科   3-5年  15-20k·12薪  2020年04月26日          空间高级设计师       深圳   \n",
       "25  大专及以上   经验不限    3-5k·12薪  2020年04月26日            行政专员岗   天津-南开区   \n",
       "26  本科及以上  5-10年  15-30k·12薪  2020年04月26日            独立站站长    杭州-西溪   \n",
       "27  大专及以上  5-10年  10-15k·12薪  2020年04月26日           园区资产总监       郑州   \n",
       "28   统招本科  5-10年  30-40k·12薪  2020年04月26日             财务总监    杭州-宁围   \n",
       "29  本科及以上   经验不限   6-10k·14薪  2020年04月26日            招商运营岗       厦门   \n",
       "30  本科及以上   经验不限  10-20k·12薪  2020年04月26日              运营岗       上海   \n",
       "31  大专及以上  5-10年          面议  2020年04月26日        建材事业部副总经理       海东   \n",
       "32  本科及以上   3-5年  15-25k·12薪  2020年04月26日          前期经理/主管       北京   \n",
       "33  大专及以上   1-3年  10-25k·12薪  2020年04月26日       嵌入式高级软件工程师       上海   \n",
       "34  本科及以上  5-10年          面议  2020年04月26日      矿山地质景观规划设计师   上海-程家桥   \n",
       "35  本科及以上   1-3年   8-12k·12薪  2020年04月26日          IR投资人关系            \n",
       "36  本科及以上   一年以下    4-9k·12薪  2020年04月26日         2020届毕业生   青岛-黄岛区   \n",
       "37   统招本科  5-10年          面议  2020年04月26日      技术总监（U3D方向）       深圳   \n",
       "38   统招本科   3-5年    4-8k·12薪  2020年04月26日        电商平台销售管理员            \n",
       "39  本科及以上   3-5年   8-15k·12薪  2020年04月26日             数据分析    上海-龙华   \n",
       "\n",
       "                  公司名称                                           链结  \\\n",
       "0         星展测控科技股份有限公司  https://www.liepin.com/job/1927789815.shtml   \n",
       "1         星展测控科技股份有限公司  https://www.liepin.com/job/1927789491.shtml   \n",
       "2       创富融资租赁(上海)有限公司  https://www.liepin.com/job/1927788671.shtml   \n",
       "3     成都零点能量信息技术有限责任公司  https://www.liepin.com/job/1927787679.shtml   \n",
       "4      承德天缘盛世房地产开发有限公司  https://www.liepin.com/job/1927785791.shtml   \n",
       "5         苏州浩辰软件股份有限公司  https://www.liepin.com/job/1927784455.shtml   \n",
       "6           上海迪罗电气有限公司  https://www.liepin.com/job/1927784195.shtml   \n",
       "7                维特奥健康  https://www.liepin.com/job/1927783939.shtml   \n",
       "8        北京斯雷康科技股份有限公司  https://www.liepin.com/job/1927783881.shtml   \n",
       "9     成都零点能量信息技术有限责任公司  https://www.liepin.com/job/1927783543.shtml   \n",
       "10                东方麦田  https://www.liepin.com/job/1927782651.shtml   \n",
       "11         常州市昂立教育培训中心  https://www.liepin.com/job/1927782409.shtml   \n",
       "12                杭康药业  https://www.liepin.com/job/1927782315.shtml   \n",
       "13        广州麦匠信息科技有限公司  https://www.liepin.com/job/1927781753.shtml   \n",
       "14       东莞市神话照明科技有限公司  https://www.liepin.com/job/1927781619.shtml   \n",
       "15                钱方好近  https://www.liepin.com/job/1927781015.shtml   \n",
       "16  重庆山水主题小镇乐园综合开发有限公司  https://www.liepin.com/job/1927780571.shtml   \n",
       "17          闻泰通讯股份有限公司  https://www.liepin.com/job/1927780385.shtml   \n",
       "18        贵州星臣教育管理有限公司  https://www.liepin.com/job/1927780343.shtml   \n",
       "19     浙江格洛博机械科技股份有限公司  https://www.liepin.com/job/1927779863.shtml   \n",
       "20                中电华瑞  https://www.liepin.com/job/1927779829.shtml   \n",
       "21      上海艾文格林教育科技有限公司  https://www.liepin.com/job/1927779743.shtml   \n",
       "22              青岛海信广场  https://www.liepin.com/job/1927779595.shtml   \n",
       "23               西域供应链  https://www.liepin.com/job/1927779263.shtml   \n",
       "24                 黄志达  https://www.liepin.com/job/1927778981.shtml   \n",
       "25                绝味食品  https://www.liepin.com/job/1927778529.shtml   \n",
       "26                新兔科技  https://www.liepin.com/job/1927778439.shtml   \n",
       "27              河南保税物流  https://www.liepin.com/job/1927778357.shtml   \n",
       "28        多弗国际地产股份有限公司  https://www.liepin.com/job/1927778333.shtml   \n",
       "29       七匹狼控股集团股份有限公司  https://www.liepin.com/job/1927778325.shtml   \n",
       "30    贵安恒信融资租赁(上海)有限公司  https://www.liepin.com/job/1927778071.shtml   \n",
       "31                金圆环保  https://www.liepin.com/job/1927777833.shtml   \n",
       "32        北京永聚铭创科技有限公司  https://www.liepin.com/job/1927776795.shtml   \n",
       "33        上海释创测控技术有限公司  https://www.liepin.com/job/1927776653.shtml   \n",
       "34                鹏欣资源  https://www.liepin.com/job/1927776223.shtml   \n",
       "35      上海多鲸企业管理咨询有限公司  https://www.liepin.com/job/1927776133.shtml   \n",
       "36        雷沃工程机械集团有限公司  https://www.liepin.com/job/1927775733.shtml   \n",
       "37       深圳国泰安教育技术有限公司  https://www.liepin.com/job/1927775275.shtml   \n",
       "38        虎牌石油(中国)有限公司  https://www.liepin.com/job/1927775097.shtml   \n",
       "39       北京斯雷康科技股份有限公司  https://www.liepin.com/job/1927774231.shtml   \n",
       "\n",
       "                                       公司URL  \n",
       "0   https://www.liepin.com/company/10158561/  \n",
       "1   https://www.liepin.com/company/10158561/  \n",
       "2    https://www.liepin.com/company/7854759/  \n",
       "3    https://www.liepin.com/company/9326766/  \n",
       "4    https://www.liepin.com/company/9143037/  \n",
       "5    https://www.liepin.com/company/7965554/  \n",
       "6    https://www.liepin.com/company/7927458/  \n",
       "7    https://www.liepin.com/company/8375949/  \n",
       "8    https://www.liepin.com/company/1408548/  \n",
       "9    https://www.liepin.com/company/9326766/  \n",
       "10   https://www.liepin.com/company/8353351/  \n",
       "11  https://www.liepin.com/company/10090569/  \n",
       "12   https://www.liepin.com/company/8247321/  \n",
       "13   https://www.liepin.com/company/9356817/  \n",
       "14   https://www.liepin.com/company/9639194/  \n",
       "15   https://www.liepin.com/company/7863496/  \n",
       "16   https://www.liepin.com/company/9946115/  \n",
       "17   https://www.liepin.com/company/7857616/  \n",
       "18   https://www.liepin.com/company/9495905/  \n",
       "19   https://www.liepin.com/company/9523207/  \n",
       "20   https://www.liepin.com/company/7887439/  \n",
       "21  https://www.liepin.com/company/10049561/  \n",
       "22   https://www.liepin.com/company/8126962/  \n",
       "23   https://www.liepin.com/company/8396469/  \n",
       "24   https://www.liepin.com/company/1668168/  \n",
       "25   https://www.liepin.com/company/9216518/  \n",
       "26  https://www.liepin.com/company/10100579/  \n",
       "27   https://www.liepin.com/company/8860911/  \n",
       "28   https://www.liepin.com/company/9725118/  \n",
       "29   https://www.liepin.com/company/7902722/  \n",
       "30   https://www.liepin.com/company/9487261/  \n",
       "31   https://www.liepin.com/company/9523659/  \n",
       "32   https://www.liepin.com/company/2218571/  \n",
       "33   https://www.liepin.com/company/8868355/  \n",
       "34   https://www.liepin.com/company/8282661/  \n",
       "35  https://www.liepin.com/company/10130433/  \n",
       "36   https://www.liepin.com/company/9209355/  \n",
       "37    https://www.liepin.com/company/870249/  \n",
       "38   https://www.liepin.com/company/8812459/  \n",
       "39   https://www.liepin.com/company/1408548/  "
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# A-1   单一页面\n",
    "url = \"https://www.liepin.com/zhaopin/?keyword=数据挖掘\"\n",
    "session = HTMLSession()\n",
    "r = session.get( url )\n",
    "\n",
    "# 先取特定元素, 精准打击其子后辈\n",
    "主要元素 = r.html.xpath( \\\n",
    "    '//ul[@class=\"sojob-list\"]/li')\n",
    "\n",
    "# 预期是一个元素的列表？\n",
    "#print (主要元素[0].xpath('//div[contains(@class,\"sojob-item-main\")]'))\n",
    "#print (主要元素[0].xpath('//div[contains(@class,\"job-info\")]/h3/a'))\n",
    "#print (主要元素[3].xpath('//div[contains(@class,\"job-info\")]/p/a'))\n",
    "#print (主要元素[3].xpath('//div[contains(@class,\"job-info\")]/p/span[@class=\"text-warning\"]'))\n",
    "#print (主要元素[3].xpath('//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]/following-sibling::span'))\n",
    "#print (主要元素[3].xpath('//div[contains(@class,\"job-info\")]/p/time/@title'))\n",
    "#print (主要元素[0].xpath('//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a'))\n",
    "\n",
    "# 作为xpath字典，键为我要抓的牛肉名称，值为xpath\n",
    "dict_xpaths={ \n",
    "    'text': {\n",
    "        'edu':      '//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]',\n",
    "        '经验':      '//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]/following-sibling::span',\n",
    "        '薪水':    '//div[contains(@class,\"job-info\")]/p/span[@class=\"text-warning\"]', \n",
    "        '时间':    '//div[contains(@class,\"job-info\")]/p/time/@title', \n",
    "        '职称':    '//div[contains(@class,\"job-info\")]/h3/a', \n",
    "        '公司地点': '//div[contains(@class,\"job-info\")]/p/a',\n",
    "        '公司名称': '//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a', \n",
    "    },\n",
    "    'text_content': {\n",
    "    },\n",
    "    'href': {\n",
    "        '链结':    '//div[contains(@class,\"job-info\")]/h3/a', \n",
    "        '公司URL': '//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a', \n",
    "    }\n",
    "}\n",
    "\n",
    "def get_e_text_content(_xpath_):\n",
    "    # 高级列表推导\n",
    "    暂存结果 = [e.xpath(_xpath_)[0].lxml.text_content() for e in 主要元素]\n",
    "    return(暂存结果)\n",
    "\n",
    "def get_e_text(_xpath_):\n",
    "    # 高级列表推导\n",
    "    暂存结果 = [\"\".join([x.strip() if type(x) is str else x.text.strip() for x in e.xpath(_xpath_)]) for e in 主要元素]\n",
    "    return(暂存结果)\n",
    "\n",
    "def get_e_href(_xpath_):\n",
    "    # 高级列表推导\n",
    "    暂存结果 = [list(e.xpath(_xpath_, first=True).absolute_links)[0] \\\n",
    "               if len(e.xpath(_xpath_, first=True).absolute_links) >= 1  \\\n",
    "               else \"\" for e in 主要元素]\n",
    "    return(暂存结果)\n",
    "\n",
    "# 只对主要元素下进行.xpath取值\n",
    "数据字典 = dict()\n",
    "\n",
    "数据字典 = {k:get_e_text_content(v) for k,v in dict_xpaths['text_content'].items()}\n",
    "数据字典.update({k:get_e_text(v) for k,v in dict_xpaths['text'].items()})\n",
    "数据字典.update({k:get_e_href(v) for k,v in dict_xpaths['href'].items()})\n",
    "\n",
    "[len(v) for k,v in 数据字典.items()]\n",
    "\n",
    "数据 = pd.DataFrame(数据字典)\n",
    "数据.to_excel(\"Web数据挖掘_week03_liepin.xlsx\", sheet_name=\"搜查结果\")\n",
    "数据 "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 公司"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[<Element 'div' class=('search-conditions',) data-selector='search-conditions'>]\n",
      "<Element 'div' class=('search-conditions',) data-selector='search-conditions'>\n",
      "[<Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>]\n",
      "公司：\n",
      "行业：\n",
      "城市：\n",
      "薪资：\n",
      "更多：\n",
      "<Element 'dd' class=('comp-list',)>\n",
      "<Element 'dd' class=('short-dd', 'select-industry') data-param='industries'>\n",
      "<Element 'dd' data-param='city'>\n",
      "<Element 'dd' data-param='salary'>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-time')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-jobkind')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-compscale')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-compkind')>\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "{'中国500强': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=155&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '2018互联网300强': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=182&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '制造业500强': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=186&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " 'AI创新成长50强 ': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=189&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '独角兽': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=130&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '上市公司': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=156&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a'}"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# A-2 扩张 公司?  \n",
    "\n",
    "# 先取特定元素, 精准打击其子后辈\n",
    "主要元素 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')\n",
    "# 预期是一个元素的列表？\n",
    "print (主要元素)\n",
    "print (主要元素[0])\n",
    "print (主要元素[0].xpath('//dt[@class=\"search-title\"]'))\n",
    "\n",
    "list_search_title = 主要元素[0].xpath('//dt[@class=\"search-title\"]')\n",
    "for x in list_search_title:\n",
    "    print (x.text)\n",
    "    \n",
    "list_search_dd = 主要元素[0].xpath('//dt[@class=\"search-title\"]/following-sibling::dd')\n",
    "for x in list_search_dd:\n",
    "    print (x)  \n",
    "    \n",
    "\n",
    "公司数据选择器链结 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')[0] \\\n",
    "                    .xpath('//dt[@class=\"search-title\"]/following-sibling::dd')[0] \\\n",
    "                    .xpath('//div[contains(@class,\"hot-comp-tags\")]/a/@href')\n",
    "               \n",
    "公司数据选择器链结\n",
    "\n",
    "# 但我们需要知道这些选择器链结, 对映到什麽数据\n",
    "公司数据选择器链结 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')[0] \\\n",
    "                    .xpath('//dt[@class=\"search-title\"]/following-sibling::dd')[0] \\\n",
    "                    .xpath('//div[contains(@class,\"hot-comp-tags\")]/a')\n",
    "公司数据选择器链结\n",
    "\n",
    "#[ x.xpath(\"a/@href\")[0] for x in 公司数据选择器链结]\n",
    "#[ x.xpath(\"a/text()\")[0] for x in 公司数据选择器链结]\n",
    "公司数据选择器链结 = { x.xpath(\"a/text()\")[0]:x.xpath(\"a/@href\")[0] for x in 公司数据选择器链结}\n",
    "公司数据选择器链结"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=155&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=182&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=186&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=189&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=130&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E6%95%B0%E6%8D%AE%E6%8C%96%E6%8E%98&compTag=156&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment='')]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from urllib.parse import urlparse, parse_qs\n",
    "[ urlparse(x) for x in 公司数据选择器链结.values()]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 6 entries, 0 to 5\n",
      "Data columns (total 6 columns):\n",
      " #   Column    Non-Null Count  Dtype \n",
      "---  ------    --------------  ----- \n",
      " 0   scheme    6 non-null      object\n",
      " 1   netloc    6 non-null      object\n",
      " 2   path      6 non-null      object\n",
      " 3   params    6 non-null      object\n",
      " 4   query     6 non-null      object\n",
      " 5   fragment  6 non-null      object\n",
      "dtypes: object(6)\n",
      "memory usage: 416.0+ bytes\n",
      "scheme      1\n",
      "netloc      1\n",
      "path        1\n",
      "params      1\n",
      "query       6\n",
      "fragment    1\n",
      "dtype: int64\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>scheme</th>\n",
       "      <th>netloc</th>\n",
       "      <th>path</th>\n",
       "      <th>params</th>\n",
       "      <th>query</th>\n",
       "      <th>fragment</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>/zhaopin/</td>\n",
       "      <td></td>\n",
       "      <td>init=-1&amp;headckid=db25195cb5dc08c4&amp;flushckid=1&amp;...</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  scheme netloc       path params  \\\n",
       "0                /zhaopin/          \n",
       "\n",
       "                                               query fragment  \n",
       "0  init=-1&headckid=db25195cb5dc08c4&flushckid=1&...           "
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "df = pd.DataFrame([ urlparse(x) for x in 公司数据选择器链结.values()])\n",
    "df.info()\n",
    "print(df.nunique())\n",
    "df.head(1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "init             1\n",
      "headckid         1\n",
      "flushckid        1\n",
      "fromSearchBtn    1\n",
      "keyword          1\n",
      "compTag          6\n",
      "ckid             1\n",
      "siTag            1\n",
      "d_sfrom          1\n",
      "d_ckId           1\n",
      "d_curPage        1\n",
      "d_pageSize       1\n",
      "d_headId         1\n",
      "dtype: int64\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>keyword</th>\n",
       "      <th>compTag</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>数据挖掘</td>\n",
       "      <td>155</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>数据挖掘</td>\n",
       "      <td>182</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>数据挖掘</td>\n",
       "      <td>186</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>数据挖掘</td>\n",
       "      <td>189</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>数据挖掘</td>\n",
       "      <td>130</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>数据挖掘</td>\n",
       "      <td>156</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  keyword compTag\n",
       "0    数据挖掘     155\n",
       "1    数据挖掘     182\n",
       "2    数据挖掘     186\n",
       "3    数据挖掘     189\n",
       "4    数据挖掘     130\n",
       "5    数据挖掘     156"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_qs = pd.DataFrame([{k:v[0] for k,v in parse_qs(x).items()} for x in df['query'] ])\n",
    "print (df_qs.nunique())\n",
    "df_qs.head()\n",
    "df_qs[['keyword','compTag']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[{'init': '-1', 'headckid': 'db25195cb5dc08c4', 'flushckid': '1', 'fromSearchBtn': '2', 'keyword': '数据挖掘', 'compTag': '155', 'ckid': 'db25195cb5dc08c4', 'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw', 'd_sfrom': 'search_unknown', 'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a', 'd_curPage': '0', 'd_pageSize': '40', 'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}, {'init': '-1', 'headckid': 'db25195cb5dc08c4', 'flushckid': '1', 'fromSearchBtn': '2', 'keyword': '数据挖掘', 'compTag': '182', 'ckid': 'db25195cb5dc08c4', 'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw', 'd_sfrom': 'search_unknown', 'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a', 'd_curPage': '0', 'd_pageSize': '40', 'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}, {'init': '-1', 'headckid': 'db25195cb5dc08c4', 'flushckid': '1', 'fromSearchBtn': '2', 'keyword': '数据挖掘', 'compTag': '186', 'ckid': 'db25195cb5dc08c4', 'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw', 'd_sfrom': 'search_unknown', 'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a', 'd_curPage': '0', 'd_pageSize': '40', 'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}, {'init': '-1', 'headckid': 'db25195cb5dc08c4', 'flushckid': '1', 'fromSearchBtn': '2', 'keyword': '数据挖掘', 'compTag': '189', 'ckid': 'db25195cb5dc08c4', 'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw', 'd_sfrom': 'search_unknown', 'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a', 'd_curPage': '0', 'd_pageSize': '40', 'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}, {'init': '-1', 'headckid': 'db25195cb5dc08c4', 'flushckid': '1', 'fromSearchBtn': '2', 'keyword': '数据挖掘', 'compTag': '130', 'ckid': 'db25195cb5dc08c4', 'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw', 'd_sfrom': 'search_unknown', 'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a', 'd_curPage': '0', 'd_pageSize': '40', 'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}, {'init': '-1', 'headckid': 'db25195cb5dc08c4', 'flushckid': '1', 'fromSearchBtn': '2', 'keyword': '数据挖掘', 'compTag': '156', 'ckid': 'db25195cb5dc08c4', 'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw', 'd_sfrom': 'search_unknown', 'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a', 'd_curPage': '0', 'd_pageSize': '40', 'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}] {'init': '-1', 'headckid': 'db25195cb5dc08c4', 'flushckid': '1', 'fromSearchBtn': '2', 'keyword': '数据挖掘', 'compTag': '156', 'ckid': 'db25195cb5dc08c4', 'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw', 'd_sfrom': 'search_unknown', 'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a', 'd_curPage': '0', 'd_pageSize': '40', 'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}\n"
     ]
    }
   ],
   "source": [
    "列表暂存 = [] \n",
    "for x in df['query']: \n",
    "    列表暂存.append({k:v[0] for k,v in parse_qs(x).items()} )\n",
    "字典暂存 = dict()\n",
    "for k,v in parse_qs(x).items():           \n",
    "    字典暂存.update({k:v[0]})\n",
    "print (列表暂存, 字典暂存) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'keyword': '数据挖掘',\n",
       "  'compTag': '155',\n",
       "  'ckid': 'db25195cb5dc08c4',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'keyword': '数据挖掘',\n",
       "  'compTag': '182',\n",
       "  'ckid': 'db25195cb5dc08c4',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'keyword': '数据挖掘',\n",
       "  'compTag': '186',\n",
       "  'ckid': 'db25195cb5dc08c4',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'keyword': '数据挖掘',\n",
       "  'compTag': '189',\n",
       "  'ckid': 'db25195cb5dc08c4',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'keyword': '数据挖掘',\n",
       "  'compTag': '130',\n",
       "  'ckid': 'db25195cb5dc08c4',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'keyword': '数据挖掘',\n",
       "  'compTag': '156',\n",
       "  'ckid': 'db25195cb5dc08c4',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}]"
      ]
     },
     "execution_count": 17,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 列表暂存\n",
    "列表暫存 = [] # list()\n",
    "for q in df['query']: \n",
    "    字典暫存 = dict()\n",
    "    for k,v in parse_qs(q).items(): # for 鍵,值 in 字典.items():\n",
    "        字典暫存.update({k:v[0]})\n",
    "    列表暫存.append(字典暫存)\n",
    "列表暫存"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'keyword': ['数据挖掘'], 'compTag': ['155'], 'ckid': ['db25195cb5dc08c4'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}\n",
      "{'中国500强': '155', '2018互联网300强': '182', '制造业500强': '186', 'AI创新成长50强 ': '189', '独角兽': '130', '上市公司': '156'}\n"
     ]
    }
   ],
   "source": [
    "# 建构参数模板及字典_compTag\n",
    "def parse_url_qs_for_compTag (url):\n",
    "    six_parts = urlparse(url) \n",
    "    out = parse_qs(six_parts.query)\n",
    "    return (out)\n",
    "\n",
    "参数模板 = parse_url_qs_for_compTag(list(公司数据选择器链结.values())[0])\n",
    "print(参数模板)\n",
    "[ parse_url_qs_for_compTag(x)['compTag'][0] for x in 公司数据选择器链结.values()]\n",
    "\n",
    "字典_compTag = { k:parse_url_qs_for_compTag(v)['compTag'][0] for k,v in 公司数据选择器链结.items()}\n",
    "print (字典_compTag)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'中国500强': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'keyword': ['用户体验'], 'compTag': ['155'], 'ckid': ['db25195cb5dc08c4'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '2018互联网300强': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'keyword': ['用户体验'], 'compTag': ['182'], 'ckid': ['db25195cb5dc08c4'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '制造业500强': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'keyword': ['用户体验'], 'compTag': ['186'], 'ckid': ['db25195cb5dc08c4'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, 'AI创新成长50强 ': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'keyword': ['用户体验'], 'compTag': ['189'], 'ckid': ['db25195cb5dc08c4'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '独角兽': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'keyword': ['用户体验'], 'compTag': ['130'], 'ckid': ['db25195cb5dc08c4'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '上市公司': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'keyword': ['用户体验'], 'compTag': ['156'], 'ckid': ['db25195cb5dc08c4'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}}\n"
     ]
    }
   ],
   "source": [
    "def 参数模板建成(compTag,keyword):\n",
    "    参数 = 参数模板.copy()\n",
    "    参数['compTag'] = compTag\n",
    "    参数['keyword'] = keyword\n",
    "    return (参数)\n",
    "参数_compTag_用户体验 = { k:参数模板建成(compTag = [v],keyword = ['用户体验']) for k,v in 字典_compTag.items()}\n",
    "print(参数_compTag_用户体验)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'https://www.liepin.com/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&compTag=155&ckid=db25195cb5dc08c4&siTag=1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a'"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 多个页面的测试\n",
    "url = \"https://www.liepin.com/zhaopin/\"\n",
    "session = HTMLSession()\n",
    "payload = 参数_compTag_用户体验['中国500强']\n",
    "r = session.get( url, params = payload)\n",
    "r.url"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "# 简化   单一页面爬+解析、创建request_liepin\n",
    "session = HTMLSession()\n",
    "\n",
    "def requests_liepin( url, params):       #创建request_liepin\n",
    "    r = session.get( url , params = payload)\n",
    "\n",
    "    # 先取特定元素, 精准打击其子后辈\n",
    "    主要元素 = r.html.xpath( '//ul[@class=\"sojob-list\"]/li')\n",
    "\n",
    "    # 作为xpath字典，键为我要抓的牛肉名称，值为xpath\n",
    "    dict_xpaths={ \n",
    "        'text': {\n",
    "            'edu':      '//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]',\n",
    "            '经验':      '//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]/following-sibling::span',\n",
    "            '薪水':    '//div[contains(@class,\"job-info\")]/p/span[@class=\"text-warning\"]', \n",
    "            '时间':    '//div[contains(@class,\"job-info\")]/p/time/@title', \n",
    "            '职称':    '//div[contains(@class,\"job-info\")]/h3/a', \n",
    "            '公司地点': '//div[contains(@class,\"job-info\")]/p/a',\n",
    "            '公司名称': '//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a', \n",
    "        },\n",
    "        'text_content': {\n",
    "        },\n",
    "        'href': {\n",
    "            '链结':    '//div[contains(@class,\"job-info\")]/h3/a', \n",
    "            '公司URL': '//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a', \n",
    "        }\n",
    "    }\n",
    "\n",
    "    def get_e_text_content(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [e.xpath(_xpath_)[0].lxml.text_content() for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    def get_e_text(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [\"\".join([x.strip() if type(x) is str else x.text.strip() for x in e.xpath(_xpath_)]) for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    def get_e_href(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [list(e.xpath(_xpath_, first=True).absolute_links)[0] \\\n",
    "                   if len(e.xpath(_xpath_, first=True).absolute_links) >= 1  \\\n",
    "                   else \"\" for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    # 只对主要元素下进行.xpath取值\n",
    "    数据字典 = dict()\n",
    "\n",
    "    数据字典 = {k:get_e_text_content(v) for k,v in dict_xpaths['text_content'].items()}\n",
    "    数据字典.update({k:get_e_text(v) for k,v in dict_xpaths['text'].items()})\n",
    "    数据字典.update({k:get_e_href(v) for k,v in dict_xpaths['href'].items()})\n",
    "\n",
    "    数据 = pd.DataFrame(数据字典)\n",
    "    数据.to_excel(\"20春_Web数据挖掘_week03_liepin.xlsx\", sheet_name=\"搜查结果\")\n",
    "    return (数据)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>edu</th>\n",
       "      <th>经验</th>\n",
       "      <th>薪水</th>\n",
       "      <th>时间</th>\n",
       "      <th>职称</th>\n",
       "      <th>公司地点</th>\n",
       "      <th>公司名称</th>\n",
       "      <th>链结</th>\n",
       "      <th>公司URL</th>\n",
       "      <th>热门公司类型</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>20-30k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>建筑结构工程师</td>\n",
       "      <td>深圳-南山区</td>\n",
       "      <td>天音控股</td>\n",
       "      <td>https://www.liepin.com/job/1926991259.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7954048/</td>\n",
       "      <td>中国500强</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月25日</td>\n",
       "      <td>频道运维岗</td>\n",
       "      <td>济南-高新区</td>\n",
       "      <td>中国重型汽车集团有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927756245.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9739005/</td>\n",
       "      <td>中国500强</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月25日</td>\n",
       "      <td>播音主持岗</td>\n",
       "      <td>济南-高新区</td>\n",
       "      <td>中国重型汽车集团有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927756189.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9739005/</td>\n",
       "      <td>中国500强</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月25日</td>\n",
       "      <td>后期制作岗</td>\n",
       "      <td>济南-高新区</td>\n",
       "      <td>中国重型汽车集团有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927756135.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9739005/</td>\n",
       "      <td>中国500强</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月25日</td>\n",
       "      <td>摄像记者岗</td>\n",
       "      <td>济南-高新区</td>\n",
       "      <td>中国重型汽车集团有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1927755771.shtml</td>\n",
       "      <td>https://www.liepin.com/company/9739005/</td>\n",
       "      <td>中国500强</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>5-8k·12薪</td>\n",
       "      <td>2020年04月17日</td>\n",
       "      <td>法务专员</td>\n",
       "      <td>沈阳-市府</td>\n",
       "      <td>微贷</td>\n",
       "      <td>https://www.liepin.com/job/1927541985.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8597281/</td>\n",
       "      <td>上市公司</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>10-20k·13薪</td>\n",
       "      <td>2020年04月16日</td>\n",
       "      <td>运营经理</td>\n",
       "      <td>佛山-顺德区</td>\n",
       "      <td>万和</td>\n",
       "      <td>https://www.liepin.com/job/1926547347.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7862193/</td>\n",
       "      <td>上市公司</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月15日</td>\n",
       "      <td>数字版权管理运营</td>\n",
       "      <td>广州-天河区</td>\n",
       "      <td>网易集团</td>\n",
       "      <td>https://www.liepin.com/job/1927471953.shtml</td>\n",
       "      <td>https://www.liepin.com/company/5964833/</td>\n",
       "      <td>上市公司</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>10-13k·12薪</td>\n",
       "      <td>2020年04月15日</td>\n",
       "      <td>法务专员(J11102)</td>\n",
       "      <td>杭州</td>\n",
       "      <td>微贷</td>\n",
       "      <td>https://www.liepin.com/job/1927470925.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8597281/</td>\n",
       "      <td>上市公司</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月15日</td>\n",
       "      <td>税务专员(J11101)</td>\n",
       "      <td>杭州-下城区</td>\n",
       "      <td>微贷</td>\n",
       "      <td>https://www.liepin.com/job/1927470269.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8597281/</td>\n",
       "      <td>上市公司</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>240 rows × 10 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      edu     经验          薪水           时间            职称    公司地点          公司名称  \\\n",
       "0   本科及以上  5-10年  20-30k·12薪  2020年04月26日       建筑结构工程师  深圳-南山区          天音控股   \n",
       "1    统招本科   1-3年          面议  2020年04月25日         频道运维岗  济南-高新区  中国重型汽车集团有限公司   \n",
       "2    统招本科   1-3年          面议  2020年04月25日         播音主持岗  济南-高新区  中国重型汽车集团有限公司   \n",
       "3    统招本科   1-3年          面议  2020年04月25日         后期制作岗  济南-高新区  中国重型汽车集团有限公司   \n",
       "4    统招本科   1-3年          面议  2020年04月25日         摄像记者岗  济南-高新区  中国重型汽车集团有限公司   \n",
       "..    ...    ...         ...          ...           ...     ...           ...   \n",
       "35   统招本科   3-5年    5-8k·12薪  2020年04月17日          法务专员   沈阳-市府            微贷   \n",
       "36  本科及以上   3-5年  10-20k·13薪  2020年04月16日          运营经理  佛山-顺德区            万和   \n",
       "37  本科及以上   经验不限          面议  2020年04月15日      数字版权管理运营  广州-天河区          网易集团   \n",
       "38  本科及以上   3-5年  10-13k·12薪  2020年04月15日  法务专员(J11102)      杭州            微贷   \n",
       "39  本科及以上   3-5年          面议  2020年04月15日  税务专员(J11101)  杭州-下城区            微贷   \n",
       "\n",
       "                                             链结  \\\n",
       "0   https://www.liepin.com/job/1926991259.shtml   \n",
       "1   https://www.liepin.com/job/1927756245.shtml   \n",
       "2   https://www.liepin.com/job/1927756189.shtml   \n",
       "3   https://www.liepin.com/job/1927756135.shtml   \n",
       "4   https://www.liepin.com/job/1927755771.shtml   \n",
       "..                                          ...   \n",
       "35  https://www.liepin.com/job/1927541985.shtml   \n",
       "36  https://www.liepin.com/job/1926547347.shtml   \n",
       "37  https://www.liepin.com/job/1927471953.shtml   \n",
       "38  https://www.liepin.com/job/1927470925.shtml   \n",
       "39  https://www.liepin.com/job/1927470269.shtml   \n",
       "\n",
       "                                      公司URL  热门公司类型  \n",
       "0   https://www.liepin.com/company/7954048/  中国500强  \n",
       "1   https://www.liepin.com/company/9739005/  中国500强  \n",
       "2   https://www.liepin.com/company/9739005/  中国500强  \n",
       "3   https://www.liepin.com/company/9739005/  中国500强  \n",
       "4   https://www.liepin.com/company/9739005/  中国500强  \n",
       "..                                      ...     ...  \n",
       "35  https://www.liepin.com/company/8597281/    上市公司  \n",
       "36  https://www.liepin.com/company/7862193/    上市公司  \n",
       "37  https://www.liepin.com/company/5964833/    上市公司  \n",
       "38  https://www.liepin.com/company/8597281/    上市公司  \n",
       "39  https://www.liepin.com/company/8597281/    上市公司  \n",
       "\n",
       "[240 rows x 10 columns]"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = \"https://www.liepin.com/zhaopin/\"\n",
    "\n",
    "list_df = list()\n",
    "for k,v in 参数_compTag_用户体验.items():\n",
    "    payload = v\n",
    "    df = requests_liepin( url, params = payload)\n",
    "    df = df.assign (热门公司类型 = k)    \n",
    "    list_df.append(df)\n",
    "\n",
    "df_all = pd.concat(list_df)\n",
    "df_all"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [],
   "source": [
    "# 输出\n",
    "df_all.to_excel(\"20春_Web数据挖掘_week03_liepin_各热门公司类型.xlsx\", sheet_name=\"搜查结果\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 行业"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[<Element 'div' class=('search-conditions',) data-selector='search-conditions'>]\n",
      "<Element 'div' class=('search-conditions',) data-selector='search-conditions'>\n",
      "[<Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>]\n",
      "公司：\n",
      "行业：\n",
      "城市：\n",
      "薪资：\n",
      "更多：\n",
      "<Element 'dd' class=('comp-list',)>\n",
      "<Element 'dd' class=('short-dd', 'select-industry') data-param='industries'>\n",
      "<Element 'dd' data-param='city'>\n",
      "<Element 'dd' data-param='salary'>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-time')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-jobkind')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-compscale')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-compkind')>\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "{'互联网/电商': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_01&industries=040&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '游戏产业': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_01&industries=420&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '计算机软件': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_01&industries=010&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " 'IT服务': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_01&industries=030&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '电子/芯片/半导体': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_02&industries=050&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '通信业': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_02&industries=060&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '计算机/网络设备': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_02&industries=020&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '房地产/建筑': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_03&industries=080&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '规划/设计/装潢': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_03&industries=100&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '房地产服务': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_03&industries=090&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '银行': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=130&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '保险': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=140&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '基金/证券/投资': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=150&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '会计/审计': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=430&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '信托/担保/拍卖': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=500&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '快消品': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=190&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '批发零售': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=240&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '服装纺织': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=200&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '家具/家电': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=210&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '办公设备': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=220&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '奢侈品/收藏品': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=460&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '珠宝/玩具/工艺品': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=470&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '汽车/摩托车': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=350&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '机械/机电/重工': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=360&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '印刷/包装/造纸': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=180&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '原材料加工': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=370&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '仪器/电气/自动化': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=340&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '制药/生物工程': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_10&industries=270&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '医疗/保健/美容': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_10&industries=280&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '医疗器械': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_10&industries=290&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '能源/水利': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=330&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '石油/化工': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=310&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '采掘/冶炼/矿产': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=320&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '环保': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=300&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '新能源': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=490&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '专业服务': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=120&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '中介服务': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=110&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '外包服务': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=440&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '检测/认证': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=450&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '餐饮/酒旅/服务': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=230&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '文体娱乐': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=260&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '租赁服务': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=510&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '广告/市场/会展': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_08&industries=070&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '影视文化': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_08&industries=170&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '教育培训': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_08&industries=380&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '交通/物流/运输': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_09&industries=250&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '贸易/进出口': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_09&industries=160&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '航空/航天': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_09&industries=480&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '政务/公共服务': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_12&industries=390&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '农林牧渔': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_12&industries=410&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       " '其他行业': '/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_12&industries=400&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a'}"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# A-2 扩张 行业 ?  \n",
    "\n",
    "# 先取特定元素, 精准打击其子后辈\n",
    "主要元素 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')\n",
    "# 预期是一个元素的列表？\n",
    "print (主要元素)\n",
    "print (主要元素[0])\n",
    "print (主要元素[0].xpath('//dt[@class=\"search-title\"]'))\n",
    "\n",
    "list_search_title = 主要元素[0].xpath('//dt[@class=\"search-title\"]')\n",
    "for x in list_search_title:\n",
    "    print (x.text)\n",
    "    \n",
    "list_search_dd = 主要元素[0].xpath('//dt[@class=\"search-title\"]/following-sibling::dd')\n",
    "for x in list_search_dd:\n",
    "    print (x)  \n",
    "    \n",
    "\n",
    "行业数据选择器链结 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')[0] \\\n",
    "                    .xpath('//dt[@class=\"search-title\"]/following-sibling::dd')[1] \\\n",
    "                    .xpath('//div[contains(@class,\"sub-industry\")]/a/@href')\n",
    "               \n",
    "行业数据选择器链结\n",
    "\n",
    "# 但我们需要知道这些选择器链结, 对映到什麽数据\n",
    "行业数据选择器链结 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')[0] \\\n",
    "                    .xpath('//dt[@class=\"search-title\"]/following-sibling::dd')[1] \\\n",
    "                    .xpath('//div[contains(@class,\"sub-industry\")]/a')\n",
    "行业数据选择器链结\n",
    "\n",
    "#[ x.xpath(\"a/@href\")[0] for x in 公司数据选择器链结]\n",
    "#[ x.xpath(\"a/text()\")[0] for x in 公司数据选择器链结]\n",
    "行业数据选择器链结 = { x.xpath(\"a/text()\")[0]:x.xpath(\"a/@href\")[0] for x in 行业数据选择器链结}\n",
    "行业数据选择器链结"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_01&industries=040&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_01&industries=420&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_01&industries=010&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_01&industries=030&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_02&industries=050&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_02&industries=060&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_02&industries=020&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_03&industries=080&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_03&industries=100&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_03&industries=090&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=130&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=140&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=150&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=430&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_04&industries=500&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=190&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=240&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=200&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=210&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=220&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=460&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_05&industries=470&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=350&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=360&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=180&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=370&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_06&industries=340&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_10&industries=270&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_10&industries=280&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_10&industries=290&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=330&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=310&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=320&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=300&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_11&industries=490&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=120&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=110&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=440&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=450&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=230&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=260&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_07&industries=510&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_08&industries=070&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_08&industries=170&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_08&industries=380&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_09&industries=250&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_09&industries=160&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_09&industries=480&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_12&industries=390&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_12&industries=410&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment=''),\n",
       " ParseResult(scheme='', netloc='', path='/zhaopin/', params='', query='init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=155&ckid=8cc408c5fb436450&subIndustry=&industryType=industry_12&industries=400&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg%7EfA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a', fragment='')]"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from urllib.parse import urlparse, parse_qs\n",
    "[ urlparse(x) for x in 行业数据选择器链结.values()]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 51 entries, 0 to 50\n",
      "Data columns (total 6 columns):\n",
      " #   Column    Non-Null Count  Dtype \n",
      "---  ------    --------------  ----- \n",
      " 0   scheme    51 non-null     object\n",
      " 1   netloc    51 non-null     object\n",
      " 2   path      51 non-null     object\n",
      " 3   params    51 non-null     object\n",
      " 4   query     51 non-null     object\n",
      " 5   fragment  51 non-null     object\n",
      "dtypes: object(6)\n",
      "memory usage: 2.5+ KB\n",
      "scheme       1\n",
      "netloc       1\n",
      "path         1\n",
      "params       1\n",
      "query       51\n",
      "fragment     1\n",
      "dtype: int64\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>scheme</th>\n",
       "      <th>netloc</th>\n",
       "      <th>path</th>\n",
       "      <th>params</th>\n",
       "      <th>query</th>\n",
       "      <th>fragment</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td></td>\n",
       "      <td></td>\n",
       "      <td>/zhaopin/</td>\n",
       "      <td></td>\n",
       "      <td>init=-1&amp;headckid=db25195cb5dc08c4&amp;flushckid=1&amp;...</td>\n",
       "      <td></td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  scheme netloc       path params  \\\n",
       "0                /zhaopin/          \n",
       "\n",
       "                                               query fragment  \n",
       "0  init=-1&headckid=db25195cb5dc08c4&flushckid=1&...           "
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "df = pd.DataFrame([ urlparse(x) for x in 行业数据选择器链结.values()])\n",
    "df.info()\n",
    "print(df.nunique())\n",
    "df.head(1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "init              1\n",
      "headckid          1\n",
      "flushckid         1\n",
      "fromSearchBtn     1\n",
      "compTag           1\n",
      "ckid              1\n",
      "industryType     12\n",
      "industries       51\n",
      "keyword           1\n",
      "siTag             1\n",
      "d_sfrom           1\n",
      "d_ckId            1\n",
      "d_curPage         1\n",
      "d_pageSize        1\n",
      "d_headId          1\n",
      "dtype: int64\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>keyword</th>\n",
       "      <th>industryType</th>\n",
       "      <th>industries</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_01</td>\n",
       "      <td>040</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_01</td>\n",
       "      <td>420</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_01</td>\n",
       "      <td>010</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_01</td>\n",
       "      <td>030</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_02</td>\n",
       "      <td>050</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_02</td>\n",
       "      <td>060</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_02</td>\n",
       "      <td>020</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_03</td>\n",
       "      <td>080</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_03</td>\n",
       "      <td>100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_03</td>\n",
       "      <td>090</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_04</td>\n",
       "      <td>130</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_04</td>\n",
       "      <td>140</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_04</td>\n",
       "      <td>150</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_04</td>\n",
       "      <td>430</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_04</td>\n",
       "      <td>500</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_05</td>\n",
       "      <td>190</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_05</td>\n",
       "      <td>240</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_05</td>\n",
       "      <td>200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_05</td>\n",
       "      <td>210</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_05</td>\n",
       "      <td>220</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_05</td>\n",
       "      <td>460</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_05</td>\n",
       "      <td>470</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_06</td>\n",
       "      <td>350</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_06</td>\n",
       "      <td>360</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_06</td>\n",
       "      <td>180</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_06</td>\n",
       "      <td>370</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_06</td>\n",
       "      <td>340</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_10</td>\n",
       "      <td>270</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_10</td>\n",
       "      <td>280</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_10</td>\n",
       "      <td>290</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_11</td>\n",
       "      <td>330</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_11</td>\n",
       "      <td>310</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_11</td>\n",
       "      <td>320</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_11</td>\n",
       "      <td>300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_11</td>\n",
       "      <td>490</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_07</td>\n",
       "      <td>120</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_07</td>\n",
       "      <td>110</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_07</td>\n",
       "      <td>440</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_07</td>\n",
       "      <td>450</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_07</td>\n",
       "      <td>230</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_07</td>\n",
       "      <td>260</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>41</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_07</td>\n",
       "      <td>510</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_08</td>\n",
       "      <td>070</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_08</td>\n",
       "      <td>170</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>44</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_08</td>\n",
       "      <td>380</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_09</td>\n",
       "      <td>250</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_09</td>\n",
       "      <td>160</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_09</td>\n",
       "      <td>480</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>48</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_12</td>\n",
       "      <td>390</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>49</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_12</td>\n",
       "      <td>410</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50</th>\n",
       "      <td>用户体验</td>\n",
       "      <td>industry_12</td>\n",
       "      <td>400</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   keyword industryType industries\n",
       "0     用户体验  industry_01        040\n",
       "1     用户体验  industry_01        420\n",
       "2     用户体验  industry_01        010\n",
       "3     用户体验  industry_01        030\n",
       "4     用户体验  industry_02        050\n",
       "5     用户体验  industry_02        060\n",
       "6     用户体验  industry_02        020\n",
       "7     用户体验  industry_03        080\n",
       "8     用户体验  industry_03        100\n",
       "9     用户体验  industry_03        090\n",
       "10    用户体验  industry_04        130\n",
       "11    用户体验  industry_04        140\n",
       "12    用户体验  industry_04        150\n",
       "13    用户体验  industry_04        430\n",
       "14    用户体验  industry_04        500\n",
       "15    用户体验  industry_05        190\n",
       "16    用户体验  industry_05        240\n",
       "17    用户体验  industry_05        200\n",
       "18    用户体验  industry_05        210\n",
       "19    用户体验  industry_05        220\n",
       "20    用户体验  industry_05        460\n",
       "21    用户体验  industry_05        470\n",
       "22    用户体验  industry_06        350\n",
       "23    用户体验  industry_06        360\n",
       "24    用户体验  industry_06        180\n",
       "25    用户体验  industry_06        370\n",
       "26    用户体验  industry_06        340\n",
       "27    用户体验  industry_10        270\n",
       "28    用户体验  industry_10        280\n",
       "29    用户体验  industry_10        290\n",
       "30    用户体验  industry_11        330\n",
       "31    用户体验  industry_11        310\n",
       "32    用户体验  industry_11        320\n",
       "33    用户体验  industry_11        300\n",
       "34    用户体验  industry_11        490\n",
       "35    用户体验  industry_07        120\n",
       "36    用户体验  industry_07        110\n",
       "37    用户体验  industry_07        440\n",
       "38    用户体验  industry_07        450\n",
       "39    用户体验  industry_07        230\n",
       "40    用户体验  industry_07        260\n",
       "41    用户体验  industry_07        510\n",
       "42    用户体验  industry_08        070\n",
       "43    用户体验  industry_08        170\n",
       "44    用户体验  industry_08        380\n",
       "45    用户体验  industry_09        250\n",
       "46    用户体验  industry_09        160\n",
       "47    用户体验  industry_09        480\n",
       "48    用户体验  industry_12        390\n",
       "49    用户体验  industry_12        410\n",
       "50    用户体验  industry_12        400"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df_qs = pd.DataFrame([{k:v[0] for k,v in parse_qs(x).items()} for x in df['query'] ])\n",
    "print (df_qs.nunique())\n",
    "df_qs.head()\n",
    "df_qs[['keyword','industryType','industries']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_01',\n",
       "  'industries': '040',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_01',\n",
       "  'industries': '420',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_01',\n",
       "  'industries': '010',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_01',\n",
       "  'industries': '030',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_02',\n",
       "  'industries': '050',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_02',\n",
       "  'industries': '060',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_02',\n",
       "  'industries': '020',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_03',\n",
       "  'industries': '080',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_03',\n",
       "  'industries': '100',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_03',\n",
       "  'industries': '090',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_04',\n",
       "  'industries': '130',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_04',\n",
       "  'industries': '140',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_04',\n",
       "  'industries': '150',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_04',\n",
       "  'industries': '430',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_04',\n",
       "  'industries': '500',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_05',\n",
       "  'industries': '190',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_05',\n",
       "  'industries': '240',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_05',\n",
       "  'industries': '200',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_05',\n",
       "  'industries': '210',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_05',\n",
       "  'industries': '220',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_05',\n",
       "  'industries': '460',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_05',\n",
       "  'industries': '470',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_06',\n",
       "  'industries': '350',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_06',\n",
       "  'industries': '360',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_06',\n",
       "  'industries': '180',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_06',\n",
       "  'industries': '370',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_06',\n",
       "  'industries': '340',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_10',\n",
       "  'industries': '270',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_10',\n",
       "  'industries': '280',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_10',\n",
       "  'industries': '290',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_11',\n",
       "  'industries': '330',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_11',\n",
       "  'industries': '310',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_11',\n",
       "  'industries': '320',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_11',\n",
       "  'industries': '300',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_11',\n",
       "  'industries': '490',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_07',\n",
       "  'industries': '120',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_07',\n",
       "  'industries': '110',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_07',\n",
       "  'industries': '440',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_07',\n",
       "  'industries': '450',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_07',\n",
       "  'industries': '230',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_07',\n",
       "  'industries': '260',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_07',\n",
       "  'industries': '510',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_08',\n",
       "  'industries': '070',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_08',\n",
       "  'industries': '170',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_08',\n",
       "  'industries': '380',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_09',\n",
       "  'industries': '250',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_09',\n",
       "  'industries': '160',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_09',\n",
       "  'industries': '480',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_12',\n",
       "  'industries': '390',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_12',\n",
       "  'industries': '410',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'},\n",
       " {'init': '-1',\n",
       "  'headckid': 'db25195cb5dc08c4',\n",
       "  'flushckid': '1',\n",
       "  'fromSearchBtn': '2',\n",
       "  'compTag': '155',\n",
       "  'ckid': '8cc408c5fb436450',\n",
       "  'industryType': 'industry_12',\n",
       "  'industries': '400',\n",
       "  'keyword': '用户体验',\n",
       "  'siTag': '1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw',\n",
       "  'd_sfrom': 'search_unknown',\n",
       "  'd_ckId': '50c8ba93d8a8c656319cfa2b9392ac3a',\n",
       "  'd_curPage': '0',\n",
       "  'd_pageSize': '40',\n",
       "  'd_headId': '50c8ba93d8a8c656319cfa2b9392ac3a'}]"
      ]
     },
     "execution_count": 28,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 经过整合后（合二为一）\n",
    "列表暫存 = [] # list()\n",
    "for q in df['query']: \n",
    "    字典暫存 = dict()\n",
    "    for k,v in parse_qs(q).items(): # for 鍵,值 in 字典.items():\n",
    "        字典暫存.update({k:v[0]})\n",
    "    列表暫存.append(字典暫存)\n",
    "列表暫存"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['155'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}\n",
      "{'互联网/电商': '040', '游戏产业': '420', '计算机软件': '010', 'IT服务': '030', '电子/芯片/半导体': '050', '通信业': '060', '计算机/网络设备': '020', '房地产/建筑': '080', '规划/设计/装潢': '100', '房地产服务': '090', '银行': '130', '保险': '140', '基金/证券/投资': '150', '会计/审计': '430', '信托/担保/拍卖': '500', '快消品': '190', '批发零售': '240', '服装纺织': '200', '家具/家电': '210', '办公设备': '220', '奢侈品/收藏品': '460', '珠宝/玩具/工艺品': '470', '汽车/摩托车': '350', '机械/机电/重工': '360', '印刷/包装/造纸': '180', '原材料加工': '370', '仪器/电气/自动化': '340', '制药/生物工程': '270', '医疗/保健/美容': '280', '医疗器械': '290', '能源/水利': '330', '石油/化工': '310', '采掘/冶炼/矿产': '320', '环保': '300', '新能源': '490', '专业服务': '120', '中介服务': '110', '外包服务': '440', '检测/认证': '450', '餐饮/酒旅/服务': '230', '文体娱乐': '260', '租赁服务': '510', '广告/市场/会展': '070', '影视文化': '170', '教育培训': '380', '交通/物流/运输': '250', '贸易/进出口': '160', '航空/航天': '480', '政务/公共服务': '390', '农林牧渔': '410', '其他行业': '400'}\n"
     ]
    }
   ],
   "source": [
    "# 建构 参数模板 及 字典_compTag\n",
    "def parse_url_qs_for_compTag (url):\n",
    "    six_parts = urlparse(url) \n",
    "    out = parse_qs(six_parts.query)\n",
    "    return (out)\n",
    "\n",
    "\n",
    "参数模板 = parse_url_qs_for_compTag(list(行业数据选择器链结.values())[0])\n",
    "print(参数模板)\n",
    "\n",
    "[ parse_url_qs_for_compTag(x)['industries'][0] for x in 行业数据选择器链结.values()]\n",
    "\n",
    "字典_compTag = { k:parse_url_qs_for_compTag(v)['industries'][0] for k,v in 行业数据选择器链结.items()}\n",
    "print (字典_compTag)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'互联网/电商': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['040'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '游戏产业': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['420'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '计算机软件': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['010'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, 'IT服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['030'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '电子/芯片/半导体': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['050'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '通信业': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['060'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '计算机/网络设备': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['020'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '房地产/建筑': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['080'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '规划/设计/装潢': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['100'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '房地产服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['090'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '银行': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['130'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '保险': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['140'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '基金/证券/投资': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['150'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '会计/审计': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['430'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '信托/担保/拍卖': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['500'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '快消品': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['190'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '批发零售': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['240'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '服装纺织': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['200'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '家具/家电': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['210'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '办公设备': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['220'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '奢侈品/收藏品': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['460'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '珠宝/玩具/工艺品': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['470'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '汽车/摩托车': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['350'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '机械/机电/重工': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['360'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '印刷/包装/造纸': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['180'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '原材料加工': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['370'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '仪器/电气/自动化': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['340'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '制药/生物工程': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['270'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '医疗/保健/美容': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['280'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '医疗器械': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['290'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '能源/水利': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['330'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '石油/化工': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['310'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '采掘/冶炼/矿产': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['320'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '环保': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['300'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '新能源': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['490'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '专业服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['120'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '中介服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['110'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '外包服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['440'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '检测/认证': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['450'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '餐饮/酒旅/服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['230'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '文体娱乐': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['260'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '租赁服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['510'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '广告/市场/会展': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['070'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '影视文化': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['170'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '教育培训': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['380'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '交通/物流/运输': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['250'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '贸易/进出口': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['160'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '航空/航天': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['480'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '政务/公共服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['390'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '农林牧渔': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['410'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '其他行业': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['400'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}}\n"
     ]
    }
   ],
   "source": [
    "def 参数模板生成(compTag , keyword ):\n",
    "    参数 = 参数模板.copy()\n",
    "    参数['compTag'] = compTag\n",
    "    参数['keyword'] = keyword\n",
    "    return (参数)\n",
    "\n",
    "参数_compTag_用户体验 = { k:参数模板生成(compTag = [v], keyword = ['用户体验']) for k,v in 字典_compTag.items()}\n",
    "print(参数_compTag_用户体验)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'https://www.liepin.com/zhaopin/?init=-1&headckid=db25195cb5dc08c4&flushckid=1&fromSearchBtn=2&compTag=190&ckid=8cc408c5fb436450&industryType=industry_01&industries=040&keyword=%E7%94%A8%E6%88%B7%E4%BD%93%E9%AA%8C&siTag=1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw&d_sfrom=search_unknown&d_ckId=50c8ba93d8a8c656319cfa2b9392ac3a&d_curPage=0&d_pageSize=40&d_headId=50c8ba93d8a8c656319cfa2b9392ac3a'"
      ]
     },
     "execution_count": 33,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 多个页面的测试\n",
    "url = \"https://www.liepin.com/zhaopin/\"\n",
    "session = HTMLSession()\n",
    "payload = 参数_compTag_用户体验['快消品']\n",
    "r = session.get( url, params = payload)\n",
    "r.url"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [],
   "source": [
    "#  简化 单一页面爬+解析\n",
    "session = HTMLSession()\n",
    "\n",
    "def requests_liepin( url, params):\n",
    "    r = session.get( url , params = payload)\n",
    "\n",
    "    # 先取特定元素, 精准打击其子后辈\n",
    "    主要元素 = r.html.xpath( '//ul[@class=\"sojob-list\"]/li')\n",
    "\n",
    "    # 作为xpath字典，键为我要抓的牛肉名称，值为xpath\n",
    "    dict_xpaths={ \n",
    "        'text': {\n",
    "            'edu':      '//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]',\n",
    "            '经验':      '//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]/following-sibling::span',\n",
    "            '薪水':    '//div[contains(@class,\"job-info\")]/p/span[@class=\"text-warning\"]', \n",
    "            '时间':    '//div[contains(@class,\"job-info\")]/p/time/@title', \n",
    "            '职称':    '//div[contains(@class,\"job-info\")]/h3/a', \n",
    "            '行业地点': '//div[contains(@class,\"job-info\")]/p/a',\n",
    "            '行业名称': '//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a', \n",
    "        },\n",
    "        'text_content': {\n",
    "        },\n",
    "        'href': {\n",
    "            '链结':    '//div[contains(@class,\"job-info\")]/h3/a', \n",
    "            '行业URL': '//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a', \n",
    "        }\n",
    "    }\n",
    "\n",
    "    def get_e_text_content(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [e.xpath(_xpath_)[0].lxml.text_content() for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    def get_e_text(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [\"\".join([x.strip() if type(x) is str else x.text.strip() for x in e.xpath(_xpath_)]) for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    def get_e_href(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [list(e.xpath(_xpath_, first=True).absolute_links)[0] \\\n",
    "                   if len(e.xpath(_xpath_, first=True).absolute_links) >= 1  \\\n",
    "                   else \"\" for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    # 只对主要元素下进行.xpath取值\n",
    "    数据字典 = dict()\n",
    "\n",
    "    数据字典 = {k:get_e_text_content(v) for k,v in dict_xpaths['text_content'].items()}\n",
    "    数据字典.update({k:get_e_text(v) for k,v in dict_xpaths['text'].items()})\n",
    "    数据字典.update({k:get_e_href(v) for k,v in dict_xpaths['href'].items()})\n",
    "\n",
    "    数据 = pd.DataFrame(数据字典)\n",
    "    return (数据)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>edu</th>\n",
       "      <th>经验</th>\n",
       "      <th>薪水</th>\n",
       "      <th>时间</th>\n",
       "      <th>职称</th>\n",
       "      <th>行业地点</th>\n",
       "      <th>行业名称</th>\n",
       "      <th>链结</th>\n",
       "      <th>行业URL</th>\n",
       "      <th>热门行业类型</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>电商运营专员</td>\n",
       "      <td>上海-闵行区</td>\n",
       "      <td>华硕电脑（上海）有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1926477641.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8134688/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>招聘专员</td>\n",
       "      <td>上海-闵行区</td>\n",
       "      <td>华硕电脑（上海）有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1925975821.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8134688/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>7-13k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>教师</td>\n",
       "      <td>武汉-洪山区</td>\n",
       "      <td>好未来</td>\n",
       "      <td>https://www.liepin.com/job/1925141209.shtml</td>\n",
       "      <td>https://www.liepin.com/company/922091/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>10-20k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>英语习题设计（题库教研）</td>\n",
       "      <td>北京</td>\n",
       "      <td>洋葱数学</td>\n",
       "      <td>https://www.liepin.com/job/1927787483.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7868882/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>8-10k·12薪</td>\n",
       "      <td>2020年04月25日</td>\n",
       "      <td>客服主管</td>\n",
       "      <td>镇江-京口区</td>\n",
       "      <td>好未来</td>\n",
       "      <td>https://www.liepin.com/job/1927762125.shtml</td>\n",
       "      <td>https://www.liepin.com/company/922091/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>25-40k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>国际支付风控（反洗钱） (MJ002842)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927254233.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>15-30k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>C++/QT/MFC Windows软件工程师 (MJ002841)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927250605.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>15-30k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>电商广告产品经理 (MJ002836)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927214861.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>16-32k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>高级主播运营-HAGO (MJ002831)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927171343.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>15-30k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>产品经理（内容分发/推荐策略）-HAGO (MJ002829)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927159049.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>240 rows × 10 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      edu     经验          薪水           时间                                  职称  \\\n",
       "0   本科及以上   经验不限          面议  2020年04月26日                              电商运营专员   \n",
       "1    统招本科   1-3年          面议  2020年04月26日                                招聘专员   \n",
       "2    统招本科   经验不限   7-13k·12薪  2020年04月26日                                  教师   \n",
       "3    统招本科   3-5年  10-20k·13薪  2020年04月26日                        英语习题设计（题库教研）   \n",
       "4    统招本科   3-5年   8-10k·12薪  2020年04月25日                                客服主管   \n",
       "..    ...    ...         ...          ...                                 ...   \n",
       "35  本科及以上  5-10年  25-40k·13薪  2020年04月26日              国际支付风控（反洗钱） (MJ002842)   \n",
       "36  本科及以上   3-5年  15-30k·13薪  2020年04月26日  C++/QT/MFC Windows软件工程师 (MJ002841)   \n",
       "37  本科及以上   3-5年  15-30k·13薪  2020年04月26日                 电商广告产品经理 (MJ002836)   \n",
       "38  本科及以上   3-5年  16-32k·13薪  2020年04月26日              高级主播运营-HAGO (MJ002831)   \n",
       "39  本科及以上   3-5年  15-30k·13薪  2020年04月26日     产品经理（内容分发/推荐策略）-HAGO (MJ002829)   \n",
       "\n",
       "      行业地点          行业名称                                           链结  \\\n",
       "0   上海-闵行区  华硕电脑（上海）有限公司  https://www.liepin.com/job/1926477641.shtml   \n",
       "1   上海-闵行区  华硕电脑（上海）有限公司  https://www.liepin.com/job/1925975821.shtml   \n",
       "2   武汉-洪山区           好未来  https://www.liepin.com/job/1925141209.shtml   \n",
       "3       北京          洋葱数学  https://www.liepin.com/job/1927787483.shtml   \n",
       "4   镇江-京口区           好未来  https://www.liepin.com/job/1927762125.shtml   \n",
       "..     ...           ...                                          ...   \n",
       "35  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927254233.shtml   \n",
       "36  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927250605.shtml   \n",
       "37  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927214861.shtml   \n",
       "38  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927171343.shtml   \n",
       "39  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927159049.shtml   \n",
       "\n",
       "                                      行业URL    热门行业类型  \n",
       "0   https://www.liepin.com/company/8134688/     计算机软件  \n",
       "1   https://www.liepin.com/company/8134688/     计算机软件  \n",
       "2    https://www.liepin.com/company/922091/     计算机软件  \n",
       "3   https://www.liepin.com/company/7868882/     计算机软件  \n",
       "4    https://www.liepin.com/company/922091/     计算机软件  \n",
       "..                                      ...       ...  \n",
       "35   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "36   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "37   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "38   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "39   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "\n",
       "[240 rows x 10 columns]"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = \"https://www.liepin.com/zhaopin/\"\n",
    "\n",
    "list_df = list()\n",
    "for k,v in 参数_compTag_用户体验.items():\n",
    "    payload = v\n",
    "    df = requests_liepin( url, params = payload)\n",
    "    df = df.assign (热门行业类型 = k)    \n",
    "    list_df.append(df)\n",
    "\n",
    "df_all = pd.concat(list_df)\n",
    "df_all"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_all.to_excel(\"20春_Web数据挖掘_week06_liepin_各热门行业类型.xlsx\", sheet_name=\"搜查结果\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 城市"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[<Element 'div' class=('search-conditions',) data-selector='search-conditions'>]\n",
      "<Element 'div' class=('search-conditions',) data-selector='search-conditions'>\n",
      "[<Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>, <Element 'dt' class=('search-title',)>]\n",
      "行业：\n",
      "细分：\n",
      "城市：\n",
      "薪资：\n",
      "更多：\n",
      "<Element 'dd' class=('short-dd', 'select-industry') data-param='industries'>\n",
      "<Element 'dd' class=('short-dd', 'select-industry') data-param='industries'>\n",
      "<Element 'dd' data-param='city'>\n",
      "<Element 'dd' data-param='salary'>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-time')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-jobkind')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-compscale')>\n",
      "<Element 'dd' class=('dropdown', 'dropdown-compkind')>\n"
     ]
    }
   ],
   "source": [
    "# A-2 扩张 城市?  \n",
    "\n",
    "# 先取特定元素, 精准打击其子后辈\n",
    "主要元素 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')\n",
    "# 预期是一个元素的列表？\n",
    "print (主要元素)\n",
    "print (主要元素[0])\n",
    "print (主要元素[0].xpath('//dt[@class=\"search-title\"]'))\n",
    "\n",
    "list_search_title = 主要元素[0].xpath('//dt[@class=\"search-title\"]')\n",
    "for x in list_search_title[1:]:\n",
    "    print (x.text)\n",
    "    \n",
    "list_search_dd = 主要元素[0].xpath('//dt[@class=\"search-title\"]/following-sibling::dd')\n",
    "for x in list_search_dd[1:]:\n",
    "    print (x)  \n",
    "    \n",
    "\n",
    "城市数据选择器链结 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')[0] \\\n",
    "                    .xpath('//dt[@class=\"search-title\"]/following-sibling::dd')[2] \\\n",
    "                    .xpath('//dd[contains(@data-param,\"city\")]/a[@class]/@href')\n",
    "               \n",
    "城市数据选择器链结\n",
    "\n",
    "# 但我们需要知道这些选择器链结, 对映到什麽数据\n",
    "城市数据选择器链结 = r.html.xpath('//div[@data-selector=\"search-conditions\"]')[0] \\\n",
    "                    .xpath('//dt[@class=\"search-title\"]/following-sibling::dd')[2] \\\n",
    "                    .xpath('//dd[contains(@data-param,\"city\")]/a[@class]')\n",
    "城市数据选择器链结\n",
    "\n",
    "#[ x.xpath(\"a/@href\")[0] for x in 公司数据选择器链结]\n",
    "#[ x.xpath(\"a/text()\")[0] for x in 公司数据选择器链结]\n",
    "城市数据选择器链结 = { x.xpath(\"a/text()\")[0]:x.xpath(\"a/@href\")[0] for x in 城市数据选择器链结[1:]}\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 66,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from urllib.parse import urlparse, parse_qs\n",
    "[ urlparse(x) for x in 城市数据选择器链结.values()]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "Index: 0 entries\n",
      "Empty DataFrameSeries([], dtype: float64)\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "Empty DataFrame\n",
       "Columns: []\n",
       "Index: []"
      ]
     },
     "execution_count": 67,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "df = pd.DataFrame([ urlparse(x) for x in 城市数据选择器链结.values()])\n",
    "df.info()\n",
    "print(df.nunique())\n",
    "df.head(1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [
    {
     "ename": "KeyError",
     "evalue": "'query'",
     "output_type": "error",
     "traceback": [
      "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[1;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
      "\u001b[1;32mD:\\anaconda\\lib\\site-packages\\pandas\\core\\indexes\\base.py\u001b[0m in \u001b[0;36mget_loc\u001b[1;34m(self, key, method, tolerance)\u001b[0m\n\u001b[0;32m   2645\u001b[0m             \u001b[1;32mtry\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 2646\u001b[1;33m                 \u001b[1;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_engine\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_loc\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   2647\u001b[0m             \u001b[1;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\index.pyx\u001b[0m in \u001b[0;36mpandas._libs.index.IndexEngine.get_loc\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\index.pyx\u001b[0m in \u001b[0;36mpandas._libs.index.IndexEngine.get_loc\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\hashtable_class_helper.pxi\u001b[0m in \u001b[0;36mpandas._libs.hashtable.PyObjectHashTable.get_item\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\hashtable_class_helper.pxi\u001b[0m in \u001b[0;36mpandas._libs.hashtable.PyObjectHashTable.get_item\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;31mKeyError\u001b[0m: 'query'",
      "\nDuring handling of the above exception, another exception occurred:\n",
      "\u001b[1;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
      "\u001b[1;32m<ipython-input-68-7f045bf28a56>\u001b[0m in \u001b[0;36m<module>\u001b[1;34m\u001b[0m\n\u001b[1;32m----> 1\u001b[1;33m \u001b[0mdf_qs\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mpd\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mDataFrame\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;33m{\u001b[0m\u001b[0mk\u001b[0m\u001b[1;33m:\u001b[0m\u001b[0mv\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;36m0\u001b[0m\u001b[1;33m]\u001b[0m \u001b[1;32mfor\u001b[0m \u001b[0mk\u001b[0m\u001b[1;33m,\u001b[0m\u001b[0mv\u001b[0m \u001b[1;32min\u001b[0m \u001b[0mparse_qs\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mx\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mitems\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m}\u001b[0m \u001b[1;32mfor\u001b[0m \u001b[0mx\u001b[0m \u001b[1;32min\u001b[0m \u001b[0mdf\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'query'\u001b[0m\u001b[1;33m]\u001b[0m \u001b[1;33m]\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m      2\u001b[0m \u001b[0mprint\u001b[0m \u001b[1;33m(\u001b[0m\u001b[0mdf_qs\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mnunique\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      3\u001b[0m \u001b[0mdf_qs\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mhead\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      4\u001b[0m \u001b[0mdf_qs\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'ckid'\u001b[0m\u001b[1;33m,\u001b[0m\u001b[1;34m'dqs'\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mD:\\anaconda\\lib\\site-packages\\pandas\\core\\frame.py\u001b[0m in \u001b[0;36m__getitem__\u001b[1;34m(self, key)\u001b[0m\n\u001b[0;32m   2798\u001b[0m             \u001b[1;32mif\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mcolumns\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mnlevels\u001b[0m \u001b[1;33m>\u001b[0m \u001b[1;36m1\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   2799\u001b[0m                 \u001b[1;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_getitem_multilevel\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 2800\u001b[1;33m             \u001b[0mindexer\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mcolumns\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_loc\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   2801\u001b[0m             \u001b[1;32mif\u001b[0m \u001b[0mis_integer\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mindexer\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   2802\u001b[0m                 \u001b[0mindexer\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;33m[\u001b[0m\u001b[0mindexer\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mD:\\anaconda\\lib\\site-packages\\pandas\\core\\indexes\\base.py\u001b[0m in \u001b[0;36mget_loc\u001b[1;34m(self, key, method, tolerance)\u001b[0m\n\u001b[0;32m   2646\u001b[0m                 \u001b[1;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_engine\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_loc\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   2647\u001b[0m             \u001b[1;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 2648\u001b[1;33m                 \u001b[1;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_engine\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_loc\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_maybe_cast_indexer\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   2649\u001b[0m         \u001b[0mindexer\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_indexer\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m[\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mmethod\u001b[0m\u001b[1;33m=\u001b[0m\u001b[0mmethod\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mtolerance\u001b[0m\u001b[1;33m=\u001b[0m\u001b[0mtolerance\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   2650\u001b[0m         \u001b[1;32mif\u001b[0m \u001b[0mindexer\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mndim\u001b[0m \u001b[1;33m>\u001b[0m \u001b[1;36m1\u001b[0m \u001b[1;32mor\u001b[0m \u001b[0mindexer\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0msize\u001b[0m \u001b[1;33m>\u001b[0m \u001b[1;36m1\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\index.pyx\u001b[0m in \u001b[0;36mpandas._libs.index.IndexEngine.get_loc\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\index.pyx\u001b[0m in \u001b[0;36mpandas._libs.index.IndexEngine.get_loc\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\hashtable_class_helper.pxi\u001b[0m in \u001b[0;36mpandas._libs.hashtable.PyObjectHashTable.get_item\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\hashtable_class_helper.pxi\u001b[0m in \u001b[0;36mpandas._libs.hashtable.PyObjectHashTable.get_item\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;31mKeyError\u001b[0m: 'query'"
     ]
    }
   ],
   "source": [
    "df_qs = pd.DataFrame([{k:v[0] for k,v in parse_qs(x).items()} for x in df['query'] ])\n",
    "print (df_qs.nunique())\n",
    "df_qs.head()\n",
    "df_qs[['ckid','dqs']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [
    {
     "ename": "KeyError",
     "evalue": "'query'",
     "output_type": "error",
     "traceback": [
      "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[1;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
      "\u001b[1;32mD:\\anaconda\\lib\\site-packages\\pandas\\core\\indexes\\base.py\u001b[0m in \u001b[0;36mget_loc\u001b[1;34m(self, key, method, tolerance)\u001b[0m\n\u001b[0;32m   2645\u001b[0m             \u001b[1;32mtry\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 2646\u001b[1;33m                 \u001b[1;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_engine\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_loc\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   2647\u001b[0m             \u001b[1;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\index.pyx\u001b[0m in \u001b[0;36mpandas._libs.index.IndexEngine.get_loc\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\index.pyx\u001b[0m in \u001b[0;36mpandas._libs.index.IndexEngine.get_loc\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\hashtable_class_helper.pxi\u001b[0m in \u001b[0;36mpandas._libs.hashtable.PyObjectHashTable.get_item\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\hashtable_class_helper.pxi\u001b[0m in \u001b[0;36mpandas._libs.hashtable.PyObjectHashTable.get_item\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;31mKeyError\u001b[0m: 'query'",
      "\nDuring handling of the above exception, another exception occurred:\n",
      "\u001b[1;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
      "\u001b[1;32m<ipython-input-69-9ea9e6178241>\u001b[0m in \u001b[0;36m<module>\u001b[1;34m\u001b[0m\n\u001b[0;32m      1\u001b[0m \u001b[0m列表暫存\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;33m[\u001b[0m\u001b[1;33m]\u001b[0m \u001b[1;31m# list()\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m----> 2\u001b[1;33m \u001b[1;32mfor\u001b[0m \u001b[0mq\u001b[0m \u001b[1;32min\u001b[0m \u001b[0mdf\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'query'\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m      3\u001b[0m     \u001b[0m字典暫存\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mdict\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      4\u001b[0m     \u001b[1;32mfor\u001b[0m \u001b[0mk\u001b[0m\u001b[1;33m,\u001b[0m\u001b[0mv\u001b[0m \u001b[1;32min\u001b[0m \u001b[0mparse_qs\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mq\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mitems\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m:\u001b[0m \u001b[1;31m# for 鍵,值 in 字典.items():\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      5\u001b[0m         \u001b[0m字典暫存\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mupdate\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m{\u001b[0m\u001b[0mk\u001b[0m\u001b[1;33m:\u001b[0m\u001b[0mv\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;36m0\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m}\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mD:\\anaconda\\lib\\site-packages\\pandas\\core\\frame.py\u001b[0m in \u001b[0;36m__getitem__\u001b[1;34m(self, key)\u001b[0m\n\u001b[0;32m   2798\u001b[0m             \u001b[1;32mif\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mcolumns\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mnlevels\u001b[0m \u001b[1;33m>\u001b[0m \u001b[1;36m1\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   2799\u001b[0m                 \u001b[1;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_getitem_multilevel\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 2800\u001b[1;33m             \u001b[0mindexer\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mcolumns\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_loc\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   2801\u001b[0m             \u001b[1;32mif\u001b[0m \u001b[0mis_integer\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mindexer\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   2802\u001b[0m                 \u001b[0mindexer\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;33m[\u001b[0m\u001b[0mindexer\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mD:\\anaconda\\lib\\site-packages\\pandas\\core\\indexes\\base.py\u001b[0m in \u001b[0;36mget_loc\u001b[1;34m(self, key, method, tolerance)\u001b[0m\n\u001b[0;32m   2646\u001b[0m                 \u001b[1;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_engine\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_loc\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   2647\u001b[0m             \u001b[1;32mexcept\u001b[0m \u001b[0mKeyError\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m-> 2648\u001b[1;33m                 \u001b[1;32mreturn\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_engine\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_loc\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0m_maybe_cast_indexer\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m   2649\u001b[0m         \u001b[0mindexer\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mself\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget_indexer\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m[\u001b[0m\u001b[0mkey\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mmethod\u001b[0m\u001b[1;33m=\u001b[0m\u001b[0mmethod\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mtolerance\u001b[0m\u001b[1;33m=\u001b[0m\u001b[0mtolerance\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m   2650\u001b[0m         \u001b[1;32mif\u001b[0m \u001b[0mindexer\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mndim\u001b[0m \u001b[1;33m>\u001b[0m \u001b[1;36m1\u001b[0m \u001b[1;32mor\u001b[0m \u001b[0mindexer\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0msize\u001b[0m \u001b[1;33m>\u001b[0m \u001b[1;36m1\u001b[0m\u001b[1;33m:\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\index.pyx\u001b[0m in \u001b[0;36mpandas._libs.index.IndexEngine.get_loc\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\index.pyx\u001b[0m in \u001b[0;36mpandas._libs.index.IndexEngine.get_loc\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\hashtable_class_helper.pxi\u001b[0m in \u001b[0;36mpandas._libs.hashtable.PyObjectHashTable.get_item\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;32mpandas\\_libs\\hashtable_class_helper.pxi\u001b[0m in \u001b[0;36mpandas._libs.hashtable.PyObjectHashTable.get_item\u001b[1;34m()\u001b[0m\n",
      "\u001b[1;31mKeyError\u001b[0m: 'query'"
     ]
    }
   ],
   "source": [
    "列表暫存 = [] # list()\n",
    "for q in df['query']: \n",
    "    字典暫存 = dict()\n",
    "    for k,v in parse_qs(q).items(): # for 鍵,值 in 字典.items():\n",
    "        字典暫存.update({k:v[0]})\n",
    "    列表暫存.append(字典暫存)\n",
    "列表暫存"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {},
   "outputs": [
    {
     "ename": "IndexError",
     "evalue": "list index out of range",
     "output_type": "error",
     "traceback": [
      "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[1;31mIndexError\u001b[0m                                Traceback (most recent call last)",
      "\u001b[1;32m<ipython-input-70-4648c26acbd0>\u001b[0m in \u001b[0;36m<module>\u001b[1;34m\u001b[0m\n\u001b[0;32m      5\u001b[0m     \u001b[1;32mreturn\u001b[0m \u001b[1;33m(\u001b[0m\u001b[0mout\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      6\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m----> 7\u001b[1;33m \u001b[0m参数模板\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mparse_url_qs_for_compTag\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0mlist\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0m城市数据选择器链结\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mvalues\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;36m0\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m      8\u001b[0m \u001b[0mprint\u001b[0m\u001b[1;33m(\u001b[0m\u001b[0m参数模板\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      9\u001b[0m \u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;31mIndexError\u001b[0m: list index out of range"
     ]
    }
   ],
   "source": [
    "# 建构 参数模板 及 字典_compTag\n",
    "def parse_url_qs_for_compTag (url):\n",
    "    six_parts = urlparse(url) \n",
    "    out = parse_qs(six_parts.query)\n",
    "    return (out)\n",
    "\n",
    "参数模板 = parse_url_qs_for_compTag(list(城市数据选择器链结.values())[0])\n",
    "print(参数模板)\n",
    "\n",
    "[ parse_url_qs_for_compTag(x)['dqs'][0] for x in 城市数据选择器链结.values()]\n",
    "\n",
    "字典_compTag = { k:parse_url_qs_for_compTag(v)['dqs'][0] for k,v in 城市数据选择器链结.items()}\n",
    "print (字典_compTag)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'互联网/电商': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['040'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '游戏产业': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['420'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '计算机软件': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['010'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, 'IT服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['030'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '电子/芯片/半导体': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['050'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '通信业': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['060'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '计算机/网络设备': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['020'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '房地产/建筑': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['080'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '规划/设计/装潢': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['100'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '房地产服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['090'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '银行': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['130'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '保险': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['140'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '基金/证券/投资': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['150'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '会计/审计': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['430'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '信托/担保/拍卖': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['500'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '快消品': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['190'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '批发零售': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['240'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '服装纺织': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['200'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '家具/家电': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['210'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '办公设备': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['220'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '奢侈品/收藏品': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['460'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '珠宝/玩具/工艺品': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['470'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '汽车/摩托车': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['350'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '机械/机电/重工': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['360'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '印刷/包装/造纸': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['180'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '原材料加工': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['370'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '仪器/电气/自动化': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['340'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '制药/生物工程': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['270'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '医疗/保健/美容': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['280'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '医疗器械': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['290'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '能源/水利': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['330'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '石油/化工': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['310'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '采掘/冶炼/矿产': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['320'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '环保': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['300'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '新能源': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['490'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '专业服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['120'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '中介服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['110'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '外包服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['440'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '检测/认证': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['450'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '餐饮/酒旅/服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['230'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '文体娱乐': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['260'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '租赁服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['510'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '广告/市场/会展': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['070'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '影视文化': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['170'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '教育培训': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['380'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '交通/物流/运输': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['250'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '贸易/进出口': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['160'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '航空/航天': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['480'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '政务/公共服务': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['390'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '农林牧渔': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['410'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}, '其他行业': {'init': ['-1'], 'headckid': ['db25195cb5dc08c4'], 'flushckid': ['1'], 'fromSearchBtn': ['2'], 'compTag': ['400'], 'ckid': ['8cc408c5fb436450'], 'industryType': ['industry_01'], 'industries': ['040'], 'keyword': ['用户体验'], 'siTag': ['1B2M2Y8AsgTpgAmY7PhCfg~fA9rXquZc5IkJpXC-Ycixw'], 'd_sfrom': ['search_unknown'], 'd_ckId': ['50c8ba93d8a8c656319cfa2b9392ac3a'], 'd_curPage': ['0'], 'd_pageSize': ['40'], 'd_headId': ['50c8ba93d8a8c656319cfa2b9392ac3a']}}\n"
     ]
    }
   ],
   "source": [
    "# 建构 参数模板  \n",
    "def 参数模板生成(compTag , keyword ):\n",
    "    参数 = 参数模板.copy()\n",
    "    参数['compTag'] = compTag\n",
    "    参数['keyword'] = keyword\n",
    "    return (参数)\n",
    "\n",
    "参数_compTag_用户体验 = { k:参数模板生成(compTag = [v], keyword = ['用户体验']) for k,v in 字典_compTag.items()}\n",
    "print(参数_compTag_用户体验)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [
    {
     "ename": "KeyError",
     "evalue": "'北京'",
     "output_type": "error",
     "traceback": [
      "\u001b[1;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[1;31mKeyError\u001b[0m                                  Traceback (most recent call last)",
      "\u001b[1;32m<ipython-input-72-47b4b244d944>\u001b[0m in \u001b[0;36m<module>\u001b[1;34m\u001b[0m\n\u001b[0;32m      2\u001b[0m \u001b[0murl\u001b[0m \u001b[1;33m=\u001b[0m \u001b[1;34m\"https://www.liepin.com/zhaopin/\"\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      3\u001b[0m \u001b[0msession\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mHTMLSession\u001b[0m\u001b[1;33m(\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[1;32m----> 4\u001b[1;33m \u001b[0mpayload\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0m参数_compTag_用户体验\u001b[0m\u001b[1;33m[\u001b[0m\u001b[1;34m'北京'\u001b[0m\u001b[1;33m]\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0m\u001b[0;32m      5\u001b[0m \u001b[0mr\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0msession\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0mget\u001b[0m\u001b[1;33m(\u001b[0m \u001b[0murl\u001b[0m\u001b[1;33m,\u001b[0m \u001b[0mparams\u001b[0m \u001b[1;33m=\u001b[0m \u001b[0mpayload\u001b[0m\u001b[1;33m)\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n\u001b[0;32m      6\u001b[0m \u001b[0mr\u001b[0m\u001b[1;33m.\u001b[0m\u001b[0murl\u001b[0m\u001b[1;33m\u001b[0m\u001b[1;33m\u001b[0m\u001b[0m\n",
      "\u001b[1;31mKeyError\u001b[0m: '北京'"
     ]
    }
   ],
   "source": [
    "# 多个页面准备测试 北京\n",
    "url = \"https://www.liepin.com/zhaopin/\"\n",
    "session = HTMLSession()\n",
    "payload = 参数_compTag_用户体验['北京']\n",
    "r = session.get( url, params = payload)\n",
    "r.url"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {},
   "outputs": [],
   "source": [
    "# 简化\n",
    "session = HTMLSession()\n",
    "\n",
    "def requests_liepin( url, params):\n",
    "    r = session.get( url , params = payload)\n",
    "\n",
    "    # 先取特定元素, 精准打击其子后辈\n",
    "    主要元素 = r.html.xpath( '//ul[@class=\"sojob-list\"]/li')\n",
    "\n",
    "    # 作为xpath字典，键为我要抓的牛肉名称，值为xpath\n",
    "    dict_xpaths={ \n",
    "        'text': {\n",
    "            'edu':      '//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]',\n",
    "            '经验':      '//div[contains(@class,\"job-info\")]/p/span[@class=\"edu\"]/following-sibling::span',\n",
    "            '薪水':    '//div[contains(@class,\"job-info\")]/p/span[@class=\"text-warning\"]', \n",
    "            '时间':    '//div[contains(@class,\"job-info\")]/p/time/@title', \n",
    "            '职称':    '//div[contains(@class,\"job-info\")]/h3/a', \n",
    "            '公司地点': '//div[contains(@class,\"job-info\")]/p/a',\n",
    "            '公司名称': '//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a', \n",
    "        },\n",
    "        'text_content': {\n",
    "        },\n",
    "        'href': {\n",
    "            '链结':    '//div[contains(@class,\"job-info\")]/h3/a', \n",
    "            '公司URL': '//div[contains(@class,\"sojob-item-main\")]//p[@class=\"company-name\"]/a', \n",
    "        }\n",
    "    }\n",
    "\n",
    "    def get_e_text_content(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [e.xpath(_xpath_)[0].lxml.text_content() for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    def get_e_text(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [\"\".join([x.strip() if type(x) is str else x.text.strip() for x in e.xpath(_xpath_)]) for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    def get_e_href(_xpath_):\n",
    "        # 高级列表推导\n",
    "        暂存结果 = [list(e.xpath(_xpath_, first=True).absolute_links)[0] \\\n",
    "                   if len(e.xpath(_xpath_, first=True).absolute_links) >= 1  \\\n",
    "                   else \"\" for e in 主要元素]\n",
    "        return(暂存结果)\n",
    "\n",
    "    # 只对主要元素下进行.xpath取值\n",
    "    数据字典 = dict()\n",
    "\n",
    "    数据字典 = {k:get_e_text_content(v) for k,v in dict_xpaths['text_content'].items()}\n",
    "    数据字典.update({k:get_e_text(v) for k,v in dict_xpaths['text'].items()})\n",
    "    数据字典.update({k:get_e_href(v) for k,v in dict_xpaths['href'].items()})\n",
    "\n",
    "    数据 = pd.DataFrame(数据字典)\n",
    "    #数据.to_excel(\"20春_Web数据挖掘_week03_liepin.xlsx\", sheet_name=\"搜查结果\")\n",
    "    return (数据)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>edu</th>\n",
       "      <th>经验</th>\n",
       "      <th>薪水</th>\n",
       "      <th>时间</th>\n",
       "      <th>职称</th>\n",
       "      <th>公司地点</th>\n",
       "      <th>公司名称</th>\n",
       "      <th>链结</th>\n",
       "      <th>公司URL</th>\n",
       "      <th>城市</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>电商运营专员</td>\n",
       "      <td>上海-闵行区</td>\n",
       "      <td>华硕电脑（上海）有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1926477641.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8134688/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>1-3年</td>\n",
       "      <td>面议</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>招聘专员</td>\n",
       "      <td>上海-闵行区</td>\n",
       "      <td>华硕电脑（上海）有限公司</td>\n",
       "      <td>https://www.liepin.com/job/1925975821.shtml</td>\n",
       "      <td>https://www.liepin.com/company/8134688/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>经验不限</td>\n",
       "      <td>7-13k·12薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>教师</td>\n",
       "      <td>武汉-洪山区</td>\n",
       "      <td>好未来</td>\n",
       "      <td>https://www.liepin.com/job/1925141209.shtml</td>\n",
       "      <td>https://www.liepin.com/company/922091/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>10-20k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>英语习题设计（题库教研）</td>\n",
       "      <td>北京</td>\n",
       "      <td>洋葱数学</td>\n",
       "      <td>https://www.liepin.com/job/1927787483.shtml</td>\n",
       "      <td>https://www.liepin.com/company/7868882/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>统招本科</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>8-10k·12薪</td>\n",
       "      <td>2020年04月25日</td>\n",
       "      <td>客服主管</td>\n",
       "      <td>镇江-京口区</td>\n",
       "      <td>好未来</td>\n",
       "      <td>https://www.liepin.com/job/1927762125.shtml</td>\n",
       "      <td>https://www.liepin.com/company/922091/</td>\n",
       "      <td>计算机软件</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>5-10年</td>\n",
       "      <td>25-40k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>国际支付风控（反洗钱） (MJ002842)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927254233.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>15-30k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>C++/QT/MFC Windows软件工程师 (MJ002841)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927250605.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>15-30k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>电商广告产品经理 (MJ002836)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927214861.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>16-32k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>高级主播运营-HAGO (MJ002831)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927171343.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>本科及以上</td>\n",
       "      <td>3-5年</td>\n",
       "      <td>15-30k·13薪</td>\n",
       "      <td>2020年04月26日</td>\n",
       "      <td>产品经理（内容分发/推荐策略）-HAGO (MJ002829)</td>\n",
       "      <td>广州-番禺区</td>\n",
       "      <td>欢聚集团</td>\n",
       "      <td>https://www.liepin.com/job/1927159049.shtml</td>\n",
       "      <td>https://www.liepin.com/company/930104/</td>\n",
       "      <td>印刷/包装/造纸</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>240 rows × 10 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      edu     经验          薪水           时间                                  职称  \\\n",
       "0   本科及以上   经验不限          面议  2020年04月26日                              电商运营专员   \n",
       "1    统招本科   1-3年          面议  2020年04月26日                                招聘专员   \n",
       "2    统招本科   经验不限   7-13k·12薪  2020年04月26日                                  教师   \n",
       "3    统招本科   3-5年  10-20k·13薪  2020年04月26日                        英语习题设计（题库教研）   \n",
       "4    统招本科   3-5年   8-10k·12薪  2020年04月25日                                客服主管   \n",
       "..    ...    ...         ...          ...                                 ...   \n",
       "35  本科及以上  5-10年  25-40k·13薪  2020年04月26日              国际支付风控（反洗钱） (MJ002842)   \n",
       "36  本科及以上   3-5年  15-30k·13薪  2020年04月26日  C++/QT/MFC Windows软件工程师 (MJ002841)   \n",
       "37  本科及以上   3-5年  15-30k·13薪  2020年04月26日                 电商广告产品经理 (MJ002836)   \n",
       "38  本科及以上   3-5年  16-32k·13薪  2020年04月26日              高级主播运营-HAGO (MJ002831)   \n",
       "39  本科及以上   3-5年  15-30k·13薪  2020年04月26日     产品经理（内容分发/推荐策略）-HAGO (MJ002829)   \n",
       "\n",
       "      公司地点          公司名称                                           链结  \\\n",
       "0   上海-闵行区  华硕电脑（上海）有限公司  https://www.liepin.com/job/1926477641.shtml   \n",
       "1   上海-闵行区  华硕电脑（上海）有限公司  https://www.liepin.com/job/1925975821.shtml   \n",
       "2   武汉-洪山区           好未来  https://www.liepin.com/job/1925141209.shtml   \n",
       "3       北京          洋葱数学  https://www.liepin.com/job/1927787483.shtml   \n",
       "4   镇江-京口区           好未来  https://www.liepin.com/job/1927762125.shtml   \n",
       "..     ...           ...                                          ...   \n",
       "35  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927254233.shtml   \n",
       "36  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927250605.shtml   \n",
       "37  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927214861.shtml   \n",
       "38  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927171343.shtml   \n",
       "39  广州-番禺区          欢聚集团  https://www.liepin.com/job/1927159049.shtml   \n",
       "\n",
       "                                      公司URL        城市  \n",
       "0   https://www.liepin.com/company/8134688/     计算机软件  \n",
       "1   https://www.liepin.com/company/8134688/     计算机软件  \n",
       "2    https://www.liepin.com/company/922091/     计算机软件  \n",
       "3   https://www.liepin.com/company/7868882/     计算机软件  \n",
       "4    https://www.liepin.com/company/922091/     计算机软件  \n",
       "..                                      ...       ...  \n",
       "35   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "36   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "37   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "38   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "39   https://www.liepin.com/company/930104/  印刷/包装/造纸  \n",
       "\n",
       "[240 rows x 10 columns]"
      ]
     },
     "execution_count": 74,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# 多个页面\n",
    "url = \"https://www.liepin.com/zhaopin/\"\n",
    "\n",
    "list_df = list()\n",
    "for k,v in 参数_compTag_用户体验.items():\n",
    "    payload = v\n",
    "    df = requests_liepin( url, params = payload)\n",
    "    df = df.assign (城市 = k)    \n",
    "    list_df.append(df)\n",
    "\n",
    "df_all = pd.concat(list_df)\n",
    "df_all"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {},
   "outputs": [],
   "source": [
    "df_all.to_excel(\"Web数据挖掘_week06_liepin_城市.xlsx\", sheet_name=\"搜查结果\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.3"
  },
  "pycharm": {
   "stem_cell": {
    "cell_type": "raw",
    "metadata": {
     "collapsed": false
    },
    "source": []
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}
